Max level shown:
12025-07-18T00:00:03.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5d71a915-e5d9-41a4-a1bd-a33a24543480 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
22025-07-18T00:00:03.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5d71a915-e5d9-41a4-a1bd-a33a24543480 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
32025-07-18T00:00:03.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5d71a915-e5d9-41a4-a1bd-a33a24543480 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
42025-07-18T00:00:04.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0c8a3a61-9632-441a-96c6-4a5251184de1 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52025-07-18T00:00:04.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0c8a3a61-9632-441a-96c6-4a5251184de1 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62025-07-18T00:00:04.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0c8a3a61-9632-441a-96c6-4a5251184de1 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72025-07-18T00:00:05.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 100 reason = Timeout
82025-07-18T00:00:05.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
92025-07-18T00:00:05.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
102025-07-18T00:00:05.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112025-07-18T00:00:05.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
122025-07-18T00:00:05.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
132025-07-18T00:00:05.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
142025-07-18T00:00:05.215ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
152025-07-18T00:00:05.215ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.612042ms iteration = 100 status = {"chicken_switches_updated":false}
162025-07-18T00:00:05.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6282294a-c30e-4b7c-84f8-83bdf5bed1e0 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
172025-07-18T00:00:05.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6282294a-c30e-4b7c-84f8-83bdf5bed1e0 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
182025-07-18T00:00:05.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6282294a-c30e-4b7c-84f8-83bdf5bed1e0 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
192025-07-18T00:00:05.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 8a8e9b32-cd8c-4067-bf06-61ae9764ca8d roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
202025-07-18T00:00:05.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 8a8e9b32-cd8c-4067-bf06-61ae9764ca8d resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
212025-07-18T00:00:05.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 8a8e9b32-cd8c-4067-bf06-61ae9764ca8d response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
222025-07-18T00:00:05.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = f50ddb7f-f14a-4a75-aea3-bd54975017ce roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
232025-07-18T00:00:05.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = f50ddb7f-f14a-4a75-aea3-bd54975017ce resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
242025-07-18T00:00:05.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = f50ddb7f-f14a-4a75-aea3-bd54975017ce response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
252025-07-18T00:00:06.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 82f6ff28-d00a-49be-80c0-787be561be6a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
262025-07-18T00:00:06.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 82f6ff28-d00a-49be-80c0-787be561be6a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
272025-07-18T00:00:06.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 82f6ff28-d00a-49be-80c0-787be561be6a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
282025-07-18T00:00:07.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 244d3295-0bb3-4973-8134-c7078b6bf85c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
292025-07-18T00:00:07.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 244d3295-0bb3-4973-8134-c7078b6bf85c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
302025-07-18T00:00:07.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 244d3295-0bb3-4973-8134-c7078b6bf85c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
312025-07-18T00:00:08.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f9785a20-c3a9-4c84-bf1e-2b6cee63989f roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
322025-07-18T00:00:08.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f9785a20-c3a9-4c84-bf1e-2b6cee63989f resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
332025-07-18T00:00:08.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f9785a20-c3a9-4c84-bf1e-2b6cee63989f response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
342025-07-18T00:00:10.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 456081f3-0306-4ba9-a613-a1199b792559 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
352025-07-18T00:00:10.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 456081f3-0306-4ba9-a613-a1199b792559 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
362025-07-18T00:00:10.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 456081f3-0306-4ba9-a613-a1199b792559 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
372025-07-18T00:00:10.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 101 reason = Timeout
382025-07-18T00:00:10.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
392025-07-18T00:00:10.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
402025-07-18T00:00:10.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
412025-07-18T00:00:10.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
422025-07-18T00:00:10.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
432025-07-18T00:00:10.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
442025-07-18T00:00:10.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
452025-07-18T00:00:10.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
462025-07-18T00:00:10.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
472025-07-18T00:00:10.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
482025-07-18T00:00:10.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
492025-07-18T00:00:10.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.264896ms iteration = 101 status = {"chicken_switches_updated":false}
502025-07-18T00:00:10.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
512025-07-18T00:00:10.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
522025-07-18T00:00:10.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
532025-07-18T00:00:10.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
542025-07-18T00:00:10.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
552025-07-18T00:00:10.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
562025-07-18T00:00:10.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
572025-07-18T00:00:10.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
582025-07-18T00:00:10.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
592025-07-18T00:00:10.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
602025-07-18T00:00:10.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
612025-07-18T00:00:10.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
622025-07-18T00:00:10.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
632025-07-18T00:00:10.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
642025-07-18T00:00:10.245ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
652025-07-18T00:00:10.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.256831ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
662025-07-18T00:00:10.255ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.205954ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
672025-07-18T00:00:10.978ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 524 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = b31dfcc9-fa60-40db-946a-bcd4765baf5f response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
682025-07-18T00:00:11.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e18b8e7a-54ce-4122-856f-afd57d51b415 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
692025-07-18T00:00:11.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e18b8e7a-54ce-4122-856f-afd57d51b415 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
702025-07-18T00:00:11.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e18b8e7a-54ce-4122-856f-afd57d51b415 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
712025-07-18T00:00:12.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9625f2ac-356b-4eb6-823d-d82e3dc15f25 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
722025-07-18T00:00:12.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9625f2ac-356b-4eb6-823d-d82e3dc15f25 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
732025-07-18T00:00:12.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9625f2ac-356b-4eb6-823d-d82e3dc15f25 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
742025-07-18T00:00:13.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2a727565-632b-4398-8535-c0347bbd2f58 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
752025-07-18T00:00:13.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2a727565-632b-4398-8535-c0347bbd2f58 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
762025-07-18T00:00:13.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2a727565-632b-4398-8535-c0347bbd2f58 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
772025-07-18T00:00:14.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e9471d14-4706-4e6f-85f0-842ad6b9421d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
782025-07-18T00:00:14.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e9471d14-4706-4e6f-85f0-842ad6b9421d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
792025-07-18T00:00:14.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e9471d14-4706-4e6f-85f0-842ad6b9421d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
802025-07-18T00:00:15.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = df13b8ff-1d3e-4062-9b77-880f541026ac roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
812025-07-18T00:00:15.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = df13b8ff-1d3e-4062-9b77-880f541026ac resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
822025-07-18T00:00:15.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = df13b8ff-1d3e-4062-9b77-880f541026ac response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
832025-07-18T00:00:15.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 102 reason = Timeout
842025-07-18T00:00:15.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
852025-07-18T00:00:15.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
862025-07-18T00:00:15.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
872025-07-18T00:00:15.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
882025-07-18T00:00:15.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
892025-07-18T00:00:15.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
902025-07-18T00:00:15.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
912025-07-18T00:00:15.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.583252ms iteration = 102 status = {"chicken_switches_updated":false}
922025-07-18T00:00:16.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e55b6ca9-b69e-4b2f-bf97-a2716aa0093b roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
932025-07-18T00:00:16.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e55b6ca9-b69e-4b2f-bf97-a2716aa0093b resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
942025-07-18T00:00:16.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e55b6ca9-b69e-4b2f-bf97-a2716aa0093b response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
952025-07-18T00:00:17.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9b2cdd23-f098-4b99-8e87-e97b3e95982c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
962025-07-18T00:00:17.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9b2cdd23-f098-4b99-8e87-e97b3e95982c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
972025-07-18T00:00:17.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9b2cdd23-f098-4b99-8e87-e97b3e95982c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
982025-07-18T00:00:18.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ada2fcf4-2a90-4ab2-aac0-8e8e6b3b65a2 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
992025-07-18T00:00:18.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ada2fcf4-2a90-4ab2-aac0-8e8e6b3b65a2 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
1002025-07-18T00:00:18.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ada2fcf4-2a90-4ab2-aac0-8e8e6b3b65a2 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
1012025-07-18T00:00:19.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d5c7f956-1472-403e-83b2-ba287aa6d9d1 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
1022025-07-18T00:00:19.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d5c7f956-1472-403e-83b2-ba287aa6d9d1 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
1032025-07-18T00:00:19.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d5c7f956-1472-403e-83b2-ba287aa6d9d1 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
1042025-07-18T00:00:20.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 627cedbb-da38-4995-a0a8-0c69e0ff9481 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
1052025-07-18T00:00:20.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 627cedbb-da38-4995-a0a8-0c69e0ff9481 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
1062025-07-18T00:00:20.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2495 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 627cedbb-da38-4995-a0a8-0c69e0ff9481 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
1072025-07-18T00:00:20.207ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
1082025-07-18T00:00:20.207ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
1092025-07-18T00:00:20.207ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1102025-07-18T00:00:20.207ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
1112025-07-18T00:00:20.207ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1122025-07-18T00:00:20.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1132025-07-18T00:00:20.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1142025-07-18T00:00:20.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 103 reason = Timeout
1152025-07-18T00:00:20.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
1162025-07-18T00:00:20.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
1172025-07-18T00:00:20.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 287693684 } })
1182025-07-18T00:00:20.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 287719244 } })
1192025-07-18T00:00:20.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
1202025-07-18T00:00:20.210ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.966386ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1212025-07-18T00:00:20.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
1222025-07-18T00:00:20.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1232025-07-18T00:00:20.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
1242025-07-18T00:00:20.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
1252025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1262025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
1272025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
1282025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1292025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1302025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1312025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
1322025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1332025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
1342025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
1352025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1362025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
1372025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
1382025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1392025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
1402025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1412025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1422025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
1432025-07-18T00:00:20.216ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1442025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1452025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
1462025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1472025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
1482025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1492025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
1502025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1512025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1522025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1532025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1542025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1552025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1562025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1572025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1582025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1592025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1602025-07-18T00:00:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1612025-07-18T00:00:20.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
1622025-07-18T00:00:20.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.056574ms iteration = 103 status = {"chicken_switches_updated":false}
1632025-07-18T00:00:20.218ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1642025-07-18T00:00:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
1652025-07-18T00:00:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
1662025-07-18T00:00:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1672025-07-18T00:00:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1682025-07-18T00:00:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
1692025-07-18T00:00:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1702025-07-18T00:00:20.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1712025-07-18T00:00:20.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1722025-07-18T00:00:20.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1732025-07-18T00:00:20.218ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1742025-07-18T00:00:20.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
1752025-07-18T00:00:20.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1762025-07-18T00:00:20.219ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 18 reason = Timeout
1772025-07-18T00:00:20.219ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
1782025-07-18T00:00:20.219ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 18 reason = Timeout
1792025-07-18T00:00:20.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
1802025-07-18T00:00:20.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1812025-07-18T00:00:20.220ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 297885591 } })
1822025-07-18T00:00:20.220ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1832025-07-18T00:00:20.220ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1842025-07-18T00:00:20.221ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1852025-07-18T00:00:20.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1862025-07-18T00:00:20.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1872025-07-18T00:00:20.222ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1882025-07-18T00:00:20.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1892025-07-18T00:00:20.222ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1902025-07-18T00:00:20.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1912025-07-18T00:00:20.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1922025-07-18T00:00:20.224ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1932025-07-18T00:00:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1942025-07-18T00:00:20.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1952025-07-18T00:00:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1962025-07-18T00:00:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1972025-07-18T00:00:20.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1982025-07-18T00:00:20.225ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1992025-07-18T00:00:20.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2002025-07-18T00:00:20.225ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2012025-07-18T00:00:20.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2022025-07-18T00:00:20.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2032025-07-18T00:00:20.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2042025-07-18T00:00:20.226ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2052025-07-18T00:00:20.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2062025-07-18T00:00:20.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2072025-07-18T00:00:20.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2082025-07-18T00:00:20.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2092025-07-18T00:00:20.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.979989ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
2102025-07-18T00:00:20.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2112025-07-18T00:00:20.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2122025-07-18T00:00:20.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2132025-07-18T00:00:20.230ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2142025-07-18T00:00:20.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2152025-07-18T00:00:20.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2162025-07-18T00:00:20.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2172025-07-18T00:00:20.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 21.889277ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
2182025-07-18T00:00:20.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2192025-07-18T00:00:20.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2202025-07-18T00:00:20.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2212025-07-18T00:00:20.250ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2222025-07-18T00:00:20.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2232025-07-18T00:00:20.252ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 32.506411ms iteration = 18 status = {"errors":[],"requests_created_ok":[]}
2242025-07-18T00:00:20.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2252025-07-18T00:00:20.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2262025-07-18T00:00:20.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2272025-07-18T00:00:20.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2282025-07-18T00:00:20.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2292025-07-18T00:00:20.253ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 331205954 } })
2302025-07-18T00:00:20.253ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
2312025-07-18T00:00:20.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2322025-07-18T00:00:20.255ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2332025-07-18T00:00:20.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2342025-07-18T00:00:20.258ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2352025-07-18T00:00:20.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2362025-07-18T00:00:20.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
2372025-07-18T00:00:20.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2382025-07-18T00:00:20.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2392025-07-18T00:00:20.284ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
2402025-07-18T00:00:20.284ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.108688ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
2412025-07-18T00:00:20.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2422025-07-18T00:00:20.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2432025-07-18T00:00:20.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.987457ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2442025-07-18T00:00:20.312ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2452025-07-18T00:00:20.312ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2462025-07-18T00:00:20.312ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2472025-07-18T00:00:20.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2482025-07-18T00:00:20.318ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2492025-07-18T00:00:20.318ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 102.075802ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2502025-07-18T00:00:20.320ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2512025-07-18T00:00:20.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2522025-07-18T00:00:20.322ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 106.090744ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2532025-07-18T00:00:20.322ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.9208ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2542025-07-18T00:00:20.323ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:389
2552025-07-18T00:00:20.323ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 107.741658ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
2562025-07-18T00:00:20.324ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
2572025-07-18T00:00:20.324ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2582025-07-18T00:00:20.324ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2592025-07-18T00:00:20.324ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c27d329-7f2a-4f8b-b7d1-ab3d5391c31e", "content-length": "26", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
2602025-07-18T00:00:20.324ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2612025-07-18T00:00:20.326ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2622025-07-18T00:00:20.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2632025-07-18T00:00:20.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2642025-07-18T00:00:20.326ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2652025-07-18T00:00:20.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2662025-07-18T00:00:20.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2672025-07-18T00:00:20.330ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2682025-07-18T00:00:20.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2692025-07-18T00:00:20.332ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2702025-07-18T00:00:20.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, lookup_type: ById(4a597d98-bd6a-42be-a09e-71b1fbba6de5) } result = Ok(())
2712025-07-18T00:00:20.335ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2722025-07-18T00:00:20.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2732025-07-18T00:00:20.338ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 122.032219ms iteration = 18 status = 0
2742025-07-18T00:00:20.345ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
2752025-07-18T00:00:20.345ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2762025-07-18T00:00:20.345ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b648c72-44f4-4041-8853-aa2d9b7641d3", "content-length": "26", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
2772025-07-18T00:00:20.345ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2782025-07-18T00:00:20.347ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2792025-07-18T00:00:20.351ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
2802025-07-18T00:00:20.351ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "f11e5f56-d806-4c76-9421-8f180535733a", "content-length": "78", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
2812025-07-18T00:00:20.351ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
2822025-07-18T00:00:20.351ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
2832025-07-18T00:00:20.351ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
2842025-07-18T00:00:20.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
2852025-07-18T00:00:20.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
2862025-07-18T00:00:20.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
2872025-07-18T00:00:20.353ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
2882025-07-18T00:00:20.354ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
2892025-07-18T00:00:20.354ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
2902025-07-18T00:00:20.357ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
2912025-07-18T00:00:20.357ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
2922025-07-18T00:00:20.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
2932025-07-18T00:00:20.357ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
2942025-07-18T00:00:20.357ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
2952025-07-18T00:00:20.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
2962025-07-18T00:00:20.358ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
2972025-07-18T00:00:20.358ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
2982025-07-18T00:00:20.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
2992025-07-18T00:00:20.360ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
3002025-07-18T00:00:20.360ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
3012025-07-18T00:00:20.360ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "d62c18b6-871d-4c87-9a26-6f6ee3dddfdb", "content-length": "81", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
3022025-07-18T00:00:20.374ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3032025-07-18T00:00:20.374ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3042025-07-18T00:00:20.374ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3052025-07-18T00:00:20.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3062025-07-18T00:00:20.376ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 158.097445ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
3072025-07-18T00:00:20.385ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 zone_address = fd00:1122:3344:101::2
3082025-07-18T00:00:20.385ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3092025-07-18T00:00:20.385ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa1fe02f-4b43-4980-ad7d-33373905fb2d", "content-length": "26", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
3102025-07-18T00:00:20.385ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3112025-07-18T00:00:20.387ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
3122025-07-18T00:00:20.392ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 176.306954ms iteration = 20 status = {"physical_disks_added":0}
3132025-07-18T00:00:20.399ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3142025-07-18T00:00:20.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3152025-07-18T00:00:20.400ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
3162025-07-18T00:00:20.400ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
3172025-07-18T00:00:20.400ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "2da528eb-4328-44cd-a64a-1b6628f4b1be", "content-length": "81", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
3182025-07-18T00:00:20.402ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
3192025-07-18T00:00:20.402ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
3202025-07-18T00:00:20.402ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdbc9524-e766-4f0c-b4ae-a7fcd4a0181b", "content-length": "81", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
3212025-07-18T00:00:20.404ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 184.432499ms iteration = 18 status = {"errors":[],"sps":[]}
3222025-07-18T00:00:20.409ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3232025-07-18T00:00:20.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3242025-07-18T00:00:20.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3252025-07-18T00:00:20.415ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3262025-07-18T00:00:20.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3272025-07-18T00:00:20.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3282025-07-18T00:00:20.418ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3292025-07-18T00:00:20.424ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3302025-07-18T00:00:20.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3312025-07-18T00:00:20.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3322025-07-18T00:00:20.434ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3332025-07-18T00:00:20.434ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3342025-07-18T00:00:20.434ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 218.23923ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3352025-07-18T00:00:20.516ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3362025-07-18T00:00:20.516ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3372025-07-18T00:00:20.517ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec949e9e-bc43-4bc1-ac9d-1bf9e62606cb", "content-length": "372", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
3382025-07-18T00:00:20.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3392025-07-18T00:00:20.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3402025-07-18T00:00:20.557ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3412025-07-18T00:00:20.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3422025-07-18T00:00:20.560ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 352.668879ms iteration = 18 status = null
3432025-07-18T00:00:20.563ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 356.543349ms iteration = 18 status = {}
3442025-07-18T00:00:20.566ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3452025-07-18T00:00:20.567ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5e77487-c209-431f-9580-06a0874bfcbf", "content-length": "691", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
3462025-07-18T00:00:20.567ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
3472025-07-18T00:00:20.567ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
3482025-07-18T00:00:20.567ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
3492025-07-18T00:00:20.569ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 353.148117ms iteration = 18 status = {}
3502025-07-18T00:00:20.572ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
3512025-07-18T00:00:20.573ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3522025-07-18T00:00:20.573ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "82f502a0-6aee-4966-b896-bfb3b694faf1", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
3532025-07-18T00:00:20.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3542025-07-18T00:00:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3552025-07-18T00:00:20.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3562025-07-18T00:00:20.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3572025-07-18T00:00:20.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3582025-07-18T00:00:20.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3592025-07-18T00:00:20.581ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3602025-07-18T00:00:20.581ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3612025-07-18T00:00:20.581ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "06dbaef1-74b9-4fda-b1d1-703c5fa9cb43", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
3622025-07-18T00:00:20.583ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 367.171752ms iteration = 18 status = {}
3632025-07-18T00:00:20.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3642025-07-18T00:00:20.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3652025-07-18T00:00:20.624ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a2d734dc-e0c9-4fd6-b442-f2c4e63791e5, rack_id: e4e73d6b-d53c-414c-93a8-eff1ed3c4807, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(9d790dba-5335-4b4c-be2a-58416dc1e8f5) } rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
3662025-07-18T00:00:20.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3672025-07-18T00:00:20.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3682025-07-18T00:00:20.634ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
3692025-07-18T00:00:20.634ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 9d790dba-5335-4b4c-be2a-58416dc1e8f5
3702025-07-18T00:00:20.634ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
3712025-07-18T00:00:20.634ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3722025-07-18T00:00:20.634ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3732025-07-18T00:00:20.634ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3742025-07-18T00:00:20.634ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3752025-07-18T00:00:20.634ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3762025-07-18T00:00:20.634ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3772025-07-18T00:00:20.634ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3782025-07-18T00:00:20.634ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
3792025-07-18T00:00:20.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3802025-07-18T00:00:20.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3812025-07-18T00:00:20.636ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
3822025-07-18T00:00:20.636ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3832025-07-18T00:00:20.845ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fa82cf74-f8af-48b8-94d5-c0159971e22c", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
3842025-07-18T00:00:20.845ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch = Switch0
3852025-07-18T00:00:20.845ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3862025-07-18T00:00:20.851ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1761b06-0e93-4ee8-9a80-e713a86e9d53", "content-length": "682", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
3872025-07-18T00:00:20.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3882025-07-18T00:00:20.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3892025-07-18T00:00:20.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3902025-07-18T00:00:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3912025-07-18T00:00:20.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3922025-07-18T00:00:20.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3932025-07-18T00:00:20.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3942025-07-18T00:00:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3952025-07-18T00:00:20.867ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 651.732374ms iteration = 18 status = {}
3962025-07-18T00:00:20.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = fa28411f-3628-42d9-9d21-8c884e344576 roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
3972025-07-18T00:00:20.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = fa28411f-3628-42d9-9d21-8c884e344576 resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
3982025-07-18T00:00:20.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = fa28411f-3628-42d9-9d21-8c884e344576 response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
3992025-07-18T00:00:20.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 18f3e20a-c7bb-4514-82be-b95e5368e829 roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
4002025-07-18T00:00:20.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 18f3e20a-c7bb-4514-82be-b95e5368e829 resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
4012025-07-18T00:00:20.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 18f3e20a-c7bb-4514-82be-b95e5368e829 response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
4022025-07-18T00:00:20.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 589 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = bd28f823-7e1f-4344-8300-cad4c43f5e6e response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
4032025-07-18T00:00:21.128ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 3
4042025-07-18T00:00:21.128ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221
4052025-07-18T00:00:21.159ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4062025-07-18T00:00:21.159ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:48316
4072025-07-18T00:00:21.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48316 req_id = b97274bb-cc82-4247-9cf3-e99af02d626c roles = RoleSet { roles: {} } uri = /metrics/producers
4082025-07-18T00:00:21.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48316 req_id = b97274bb-cc82-4247-9cf3-e99af02d626c resource = Database result = Ok(()) uri = /metrics/producers
4092025-07-18T00:00:21.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5111c904-1318-4975-8776-c2eab751065e roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4102025-07-18T00:00:21.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5111c904-1318-4975-8776-c2eab751065e resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4112025-07-18T00:00:21.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5111c904-1318-4975-8776-c2eab751065e response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4122025-07-18T00:00:21.210ZINFOnexus: assigned collector to new producer collector_id = 13431648-c0eb-4fbe-bcca-ada1fdea1060 file = nexus/src/app/oximeter.rs:76 producer_id = 79e7c92c-8e83-4180-bbfe-92325edee698
4132025-07-18T00:00:21.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 51403 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48316 req_id = b97274bb-cc82-4247-9cf3-e99af02d626c response_code = 201 uri = /metrics/producers
4142025-07-18T00:00:21.211ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b97274bb-cc82-4247-9cf3-e99af02d626c", "content-length": "41", "date": "Fri, 18 Jul 2025 00:00:20 GMT"} })
4152025-07-18T00:00:21.213ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
4162025-07-18T00:00:22.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a2908dd1-c6ce-4947-bfc3-036a26bed1b1 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4172025-07-18T00:00:22.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a2908dd1-c6ce-4947-bfc3-036a26bed1b1 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4182025-07-18T00:00:22.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 6548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a2908dd1-c6ce-4947-bfc3-036a26bed1b1 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4192025-07-18T00:00:23.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4893a01c-ac90-4eca-9273-e899e0655716 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4202025-07-18T00:00:23.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4893a01c-ac90-4eca-9273-e899e0655716 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4212025-07-18T00:00:23.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4893a01c-ac90-4eca-9273-e899e0655716 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4222025-07-18T00:00:24.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d59d3a4f-f7fa-4d36-96a0-b295e94eeeef roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4232025-07-18T00:00:24.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d59d3a4f-f7fa-4d36-96a0-b295e94eeeef resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4242025-07-18T00:00:24.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d59d3a4f-f7fa-4d36-96a0-b295e94eeeef response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4252025-07-18T00:00:25.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 104 reason = Timeout
4262025-07-18T00:00:25.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
4272025-07-18T00:00:25.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
4282025-07-18T00:00:25.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4292025-07-18T00:00:25.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
4302025-07-18T00:00:25.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
4312025-07-18T00:00:25.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
4322025-07-18T00:00:25.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
4332025-07-18T00:00:25.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.647932ms iteration = 104 status = {"chicken_switches_updated":false}
4342025-07-18T00:00:25.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7842b987-d072-4ff3-b678-f37d1c86db62 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4352025-07-18T00:00:25.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7842b987-d072-4ff3-b678-f37d1c86db62 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4362025-07-18T00:00:25.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7842b987-d072-4ff3-b678-f37d1c86db62 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4372025-07-18T00:00:26.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5e3a768d-57ac-4f3d-b73b-3a8f4dc3d113 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4382025-07-18T00:00:26.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5e3a768d-57ac-4f3d-b73b-3a8f4dc3d113 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4392025-07-18T00:00:26.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5e3a768d-57ac-4f3d-b73b-3a8f4dc3d113 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4402025-07-18T00:00:27.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 822a6d4a-52be-4403-ac30-703230531543 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4412025-07-18T00:00:27.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 822a6d4a-52be-4403-ac30-703230531543 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4422025-07-18T00:00:27.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 822a6d4a-52be-4403-ac30-703230531543 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4432025-07-18T00:00:28.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5fdd9bc5-0746-4fc9-aa49-c03dd2829ca4 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4442025-07-18T00:00:28.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5fdd9bc5-0746-4fc9-aa49-c03dd2829ca4 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4452025-07-18T00:00:28.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5fdd9bc5-0746-4fc9-aa49-c03dd2829ca4 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4462025-07-18T00:00:29.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 41f8c98d-9eab-4583-bfe7-2fd19237ac3e roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4472025-07-18T00:00:29.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 41f8c98d-9eab-4583-bfe7-2fd19237ac3e resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4482025-07-18T00:00:29.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 41f8c98d-9eab-4583-bfe7-2fd19237ac3e response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4492025-07-18T00:00:30.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 105 reason = Timeout
4502025-07-18T00:00:30.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
4512025-07-18T00:00:30.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
4522025-07-18T00:00:30.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4532025-07-18T00:00:30.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
4542025-07-18T00:00:30.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
4552025-07-18T00:00:30.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
4562025-07-18T00:00:30.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
4572025-07-18T00:00:30.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
4582025-07-18T00:00:30.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4592025-07-18T00:00:30.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4602025-07-18T00:00:30.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4612025-07-18T00:00:30.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4622025-07-18T00:00:30.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
4632025-07-18T00:00:30.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.058428ms iteration = 105 status = {"chicken_switches_updated":false}
4642025-07-18T00:00:30.219ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4652025-07-18T00:00:30.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4662025-07-18T00:00:30.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4672025-07-18T00:00:30.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4682025-07-18T00:00:30.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4692025-07-18T00:00:30.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4702025-07-18T00:00:30.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4712025-07-18T00:00:30.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4722025-07-18T00:00:30.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4732025-07-18T00:00:30.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
4742025-07-18T00:00:30.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4752025-07-18T00:00:30.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4762025-07-18T00:00:30.242ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
4772025-07-18T00:00:30.242ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.902329ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
4782025-07-18T00:00:30.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.843707ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4792025-07-18T00:00:30.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5ec235d3-7b4b-4c84-a327-7f145e263992 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4802025-07-18T00:00:30.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5ec235d3-7b4b-4c84-a327-7f145e263992 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4812025-07-18T00:00:30.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5ec235d3-7b4b-4c84-a327-7f145e263992 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4822025-07-18T00:00:30.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 621 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = eec1c90a-4e45-4c2a-907f-fddd67065b0f response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
4832025-07-18T00:00:31.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d525a15f-5219-4b69-941b-9594e211b0cc roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4842025-07-18T00:00:31.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d525a15f-5219-4b69-941b-9594e211b0cc resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4852025-07-18T00:00:31.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d525a15f-5219-4b69-941b-9594e211b0cc response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4862025-07-18T00:00:32.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8bf09039-3303-478c-a6ac-588dd4796797 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4872025-07-18T00:00:32.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8bf09039-3303-478c-a6ac-588dd4796797 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4882025-07-18T00:00:32.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8bf09039-3303-478c-a6ac-588dd4796797 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4892025-07-18T00:00:33.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 191c12db-8b79-486d-8ae4-4dfc235e7139 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4902025-07-18T00:00:33.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 191c12db-8b79-486d-8ae4-4dfc235e7139 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4912025-07-18T00:00:33.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 191c12db-8b79-486d-8ae4-4dfc235e7139 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4922025-07-18T00:00:34.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0be205d1-363d-4a6c-86b3-22d6db2821af roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4932025-07-18T00:00:34.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0be205d1-363d-4a6c-86b3-22d6db2821af resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4942025-07-18T00:00:34.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0be205d1-363d-4a6c-86b3-22d6db2821af response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
4952025-07-18T00:00:35.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 106 reason = Timeout
4962025-07-18T00:00:35.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
4972025-07-18T00:00:35.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
4982025-07-18T00:00:35.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4992025-07-18T00:00:35.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
5002025-07-18T00:00:35.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
5012025-07-18T00:00:35.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
5022025-07-18T00:00:35.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
5032025-07-18T00:00:35.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.836515ms iteration = 106 status = {"chicken_switches_updated":false}
5042025-07-18T00:00:35.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 009b23df-6657-42f4-9d86-5aa2bed78978 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5052025-07-18T00:00:35.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 009b23df-6657-42f4-9d86-5aa2bed78978 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5062025-07-18T00:00:35.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 009b23df-6657-42f4-9d86-5aa2bed78978 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5072025-07-18T00:00:36.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bf1a000b-3dff-4605-bfce-15eb231f1076 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5082025-07-18T00:00:36.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bf1a000b-3dff-4605-bfce-15eb231f1076 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5092025-07-18T00:00:36.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bf1a000b-3dff-4605-bfce-15eb231f1076 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5102025-07-18T00:00:37.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1ed9fa23-8ab2-4a4b-a773-18f389d6ac0a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5112025-07-18T00:00:37.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1ed9fa23-8ab2-4a4b-a773-18f389d6ac0a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5122025-07-18T00:00:37.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1ed9fa23-8ab2-4a4b-a773-18f389d6ac0a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5132025-07-18T00:00:38.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 04de01e4-b4f5-48fb-9261-8740df64a4e4 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5142025-07-18T00:00:38.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 04de01e4-b4f5-48fb-9261-8740df64a4e4 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5152025-07-18T00:00:38.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 04de01e4-b4f5-48fb-9261-8740df64a4e4 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5162025-07-18T00:00:39.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = dc50314f-4790-4f93-b448-5d72b614330a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5172025-07-18T00:00:39.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = dc50314f-4790-4f93-b448-5d72b614330a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5182025-07-18T00:00:39.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = dc50314f-4790-4f93-b448-5d72b614330a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5192025-07-18T00:00:40.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 107 reason = Timeout
5202025-07-18T00:00:40.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
5212025-07-18T00:00:40.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
5222025-07-18T00:00:40.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5232025-07-18T00:00:40.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
5242025-07-18T00:00:40.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
5252025-07-18T00:00:40.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
5262025-07-18T00:00:40.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
5272025-07-18T00:00:40.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
5282025-07-18T00:00:40.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5292025-07-18T00:00:40.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5302025-07-18T00:00:40.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5312025-07-18T00:00:40.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5322025-07-18T00:00:40.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
5332025-07-18T00:00:40.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.497055ms iteration = 107 status = {"chicken_switches_updated":false}
5342025-07-18T00:00:40.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5352025-07-18T00:00:40.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5362025-07-18T00:00:40.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5372025-07-18T00:00:40.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.89429ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5382025-07-18T00:00:40.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5392025-07-18T00:00:40.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5402025-07-18T00:00:40.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5412025-07-18T00:00:40.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5422025-07-18T00:00:40.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5432025-07-18T00:00:40.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5442025-07-18T00:00:40.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
5452025-07-18T00:00:40.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5462025-07-18T00:00:40.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5472025-07-18T00:00:40.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
5482025-07-18T00:00:40.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.655183ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
5492025-07-18T00:00:40.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 45bde506-3294-4a9b-9249-fcb9ab33e5c3 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5502025-07-18T00:00:40.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 45bde506-3294-4a9b-9249-fcb9ab33e5c3 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5512025-07-18T00:00:40.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 45bde506-3294-4a9b-9249-fcb9ab33e5c3 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5522025-07-18T00:00:40.978ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 533 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = f0e516dc-0b43-4cb4-b702-cd85474d2848 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
5532025-07-18T00:00:41.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c03546f3-4cd5-47d2-824f-262c9cc36c43 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5542025-07-18T00:00:41.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c03546f3-4cd5-47d2-824f-262c9cc36c43 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5552025-07-18T00:00:41.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c03546f3-4cd5-47d2-824f-262c9cc36c43 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5562025-07-18T00:00:42.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 00b9c07a-cbf4-4990-9ee8-808458e3241f roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5572025-07-18T00:00:42.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 00b9c07a-cbf4-4990-9ee8-808458e3241f resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5582025-07-18T00:00:42.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 00b9c07a-cbf4-4990-9ee8-808458e3241f response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5592025-07-18T00:00:43.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = dc01aee1-13b3-4989-858a-77eeb4ffeaaa roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5602025-07-18T00:00:43.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = dc01aee1-13b3-4989-858a-77eeb4ffeaaa resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5612025-07-18T00:00:43.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = dc01aee1-13b3-4989-858a-77eeb4ffeaaa response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5622025-07-18T00:00:44.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d4ac5ba7-4923-4a54-ac52-b70f7bed8a9c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5632025-07-18T00:00:44.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d4ac5ba7-4923-4a54-ac52-b70f7bed8a9c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5642025-07-18T00:00:44.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d4ac5ba7-4923-4a54-ac52-b70f7bed8a9c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5652025-07-18T00:00:45.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 108 reason = Timeout
5662025-07-18T00:00:45.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
5672025-07-18T00:00:45.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
5682025-07-18T00:00:45.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5692025-07-18T00:00:45.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
5702025-07-18T00:00:45.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
5712025-07-18T00:00:45.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
5722025-07-18T00:00:45.215ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
5732025-07-18T00:00:45.215ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.145615ms iteration = 108 status = {"chicken_switches_updated":false}
5742025-07-18T00:00:45.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 95a7d5b9-433f-4da2-a39f-9be7b235c947 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5752025-07-18T00:00:45.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 95a7d5b9-433f-4da2-a39f-9be7b235c947 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5762025-07-18T00:00:45.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 95a7d5b9-433f-4da2-a39f-9be7b235c947 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5772025-07-18T00:00:46.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9e22253d-7ab3-47ee-b274-62434c2bd74a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5782025-07-18T00:00:46.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9e22253d-7ab3-47ee-b274-62434c2bd74a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5792025-07-18T00:00:46.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1930 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9e22253d-7ab3-47ee-b274-62434c2bd74a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5802025-07-18T00:00:47.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a1c54424-590d-4dd1-9676-d285e2009bc5 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5812025-07-18T00:00:47.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a1c54424-590d-4dd1-9676-d285e2009bc5 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5822025-07-18T00:00:47.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a1c54424-590d-4dd1-9676-d285e2009bc5 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5832025-07-18T00:00:48.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ee898483-cf7a-4188-9ea4-7ac1d802281f roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5842025-07-18T00:00:48.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ee898483-cf7a-4188-9ea4-7ac1d802281f resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5852025-07-18T00:00:48.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ee898483-cf7a-4188-9ea4-7ac1d802281f response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5862025-07-18T00:00:49.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a2b702e8-04ca-4cab-87d3-5e128a317349 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5872025-07-18T00:00:49.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a2b702e8-04ca-4cab-87d3-5e128a317349 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5882025-07-18T00:00:49.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2692 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a2b702e8-04ca-4cab-87d3-5e128a317349 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
5892025-07-18T00:00:50.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
5902025-07-18T00:00:50.204ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
5912025-07-18T00:00:50.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5922025-07-18T00:00:50.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5932025-07-18T00:00:50.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5942025-07-18T00:00:50.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5952025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5962025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
5972025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
5982025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
5992025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
6002025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6012025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
6022025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
6032025-07-18T00:00:50.207ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-17 23:50:50.207157655 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
6042025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
6052025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
6062025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6072025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
6082025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
6092025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
6102025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6112025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
6122025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6132025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6142025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6152025-07-18T00:00:50.207ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("464a3447-fe1f-417e-b585-925f5fb5bfdc.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da3261f0-45ba-4fbf-b6bb-a5a70850db80.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("da3261f0-45ba-4fbf-b6bb-a5a70850db80.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 285762984 } })
6162025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6172025-07-18T00:00:50.207ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("56b8d8b3-74d8-49ff-9bba-ff575bfeff38.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b6789fb-7f6d-466d-9e8d-08234eb15cb4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eee78e3b-9d92-4bbf-a496-9511487338e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("eee78e3b-9d92-4bbf-a496-9511487338e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:3::1)) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 285805835 } })
6182025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
6192025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
6202025-07-18T00:00:50.207ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 9092da00-a622-42cf-99af-453ea64d4a35
6212025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.41\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"9092da00-a622-42cf-99af-453ea64d4a35"}
6222025-07-18T00:00:50.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6232025-07-18T00:00:50.208ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
6242025-07-18T00:00:50.208ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.022136ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
6252025-07-18T00:00:50.208ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
6262025-07-18T00:00:50.208ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.060567ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
6272025-07-18T00:00:50.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6282025-07-18T00:00:50.209ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 13 reason = Timeout
6292025-07-18T00:00:50.209ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
6302025-07-18T00:00:50.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 109 reason = Timeout
6312025-07-18T00:00:50.209ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 9.53\u{b5}s iteration = 13 status = "Disabled"
6322025-07-18T00:00:50.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
6332025-07-18T00:00:50.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6342025-07-18T00:00:50.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
6352025-07-18T00:00:50.209ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 287602543 } })
6362025-07-18T00:00:50.209ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
6372025-07-18T00:00:50.211ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.163044ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6382025-07-18T00:00:50.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6392025-07-18T00:00:50.211ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-17 23:50:50.207157655 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
6402025-07-18T00:00:50.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 289644864 } })
6412025-07-18T00:00:50.211ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.332327ms iteration = 10 status = {"expiration":"2025-07-17T23:50:50.207157655Z","pruned":[]}
6422025-07-18T00:00:50.211ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6432025-07-18T00:00:50.211ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6442025-07-18T00:00:50.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
6452025-07-18T00:00:50.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6462025-07-18T00:00:50.212ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6472025-07-18T00:00:50.212ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6482025-07-18T00:00:50.212ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6492025-07-18T00:00:50.212ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6502025-07-18T00:00:50.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6512025-07-18T00:00:50.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6522025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6532025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6542025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6552025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
6562025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
6572025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
6582025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6592025-07-18T00:00:50.215ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6602025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6612025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
6622025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6632025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6642025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6652025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
6662025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
6672025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6682025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6692025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
6702025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6712025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
6722025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6732025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
6742025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6752025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
6762025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6772025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
6782025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
6792025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
6802025-07-18T00:00:50.215ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
6812025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6822025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
6832025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6842025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
6852025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6862025-07-18T00:00:50.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
6872025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6882025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6892025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6902025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6912025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6922025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6932025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6942025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6952025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6962025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6972025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6982025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6992025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
7002025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7012025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
7022025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7032025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
7042025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7052025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7062025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7072025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7082025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7092025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7102025-07-18T00:00:50.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7112025-07-18T00:00:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7122025-07-18T00:00:50.217ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
7132025-07-18T00:00:50.217ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
7142025-07-18T00:00:50.217ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
7152025-07-18T00:00:50.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7162025-07-18T00:00:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
7172025-07-18T00:00:50.217ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
7182025-07-18T00:00:50.217ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7192025-07-18T00:00:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7202025-07-18T00:00:50.217ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7212025-07-18T00:00:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
7222025-07-18T00:00:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7232025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7242025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
7252025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
7262025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
7272025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7282025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
7292025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
7302025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
7312025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7322025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7332025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7342025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7352025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
7362025-07-18T00:00:50.218ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7372025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7382025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 10 reason = Timeout
7392025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
7402025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
7412025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7422025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 10 reason = Timeout
7432025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
7442025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
7452025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
7462025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 19 reason = Timeout
7472025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
7482025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7492025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
7502025-07-18T00:00:50.219ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 298006843 } })
7512025-07-18T00:00:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
7522025-07-18T00:00:50.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7532025-07-18T00:00:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7542025-07-18T00:00:50.220ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7552025-07-18T00:00:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7562025-07-18T00:00:50.221ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7572025-07-18T00:00:50.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7582025-07-18T00:00:50.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7592025-07-18T00:00:50.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7602025-07-18T00:00:50.222ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7612025-07-18T00:00:50.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7622025-07-18T00:00:50.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7632025-07-18T00:00:50.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
7642025-07-18T00:00:50.223ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7652025-07-18T00:00:50.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7662025-07-18T00:00:50.223ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7672025-07-18T00:00:50.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7682025-07-18T00:00:50.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7692025-07-18T00:00:50.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7702025-07-18T00:00:50.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7712025-07-18T00:00:50.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7722025-07-18T00:00:50.224ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7732025-07-18T00:00:50.224ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7742025-07-18T00:00:50.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7752025-07-18T00:00:50.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7762025-07-18T00:00:50.225ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
7772025-07-18T00:00:50.225ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
7782025-07-18T00:00:50.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7792025-07-18T00:00:50.225ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.822131ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
7802025-07-18T00:00:50.226ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7812025-07-18T00:00:50.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7822025-07-18T00:00:50.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7832025-07-18T00:00:50.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7842025-07-18T00:00:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
7852025-07-18T00:00:50.228ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
7862025-07-18T00:00:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7872025-07-18T00:00:50.228ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7882025-07-18T00:00:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
7892025-07-18T00:00:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7902025-07-18T00:00:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
7912025-07-18T00:00:50.229ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7922025-07-18T00:00:50.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7932025-07-18T00:00:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7942025-07-18T00:00:50.229ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7952025-07-18T00:00:50.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7962025-07-18T00:00:50.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7972025-07-18T00:00:50.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7982025-07-18T00:00:50.231ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
7992025-07-18T00:00:50.231ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 21.968229ms iteration = 109 status = {"chicken_switches_updated":false}
8002025-07-18T00:00:50.231ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8012025-07-18T00:00:50.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
8022025-07-18T00:00:50.232ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8032025-07-18T00:00:50.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8042025-07-18T00:00:50.234ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8052025-07-18T00:00:50.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8062025-07-18T00:00:50.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8072025-07-18T00:00:50.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8082025-07-18T00:00:50.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
8092025-07-18T00:00:50.235ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8102025-07-18T00:00:50.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8112025-07-18T00:00:50.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
8122025-07-18T00:00:50.237ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8132025-07-18T00:00:50.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8142025-07-18T00:00:50.237ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8152025-07-18T00:00:50.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8162025-07-18T00:00:50.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8172025-07-18T00:00:50.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8182025-07-18T00:00:50.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8192025-07-18T00:00:50.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
8202025-07-18T00:00:50.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8212025-07-18T00:00:50.241ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.065806ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
8222025-07-18T00:00:50.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8232025-07-18T00:00:50.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 22.049829ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
8242025-07-18T00:00:50.242ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
8252025-07-18T00:00:50.242ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 22.904343ms iteration = 10 status = {"by_rx":{},"error":null}
8262025-07-18T00:00:50.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8272025-07-18T00:00:50.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8282025-07-18T00:00:50.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8292025-07-18T00:00:50.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8302025-07-18T00:00:50.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8312025-07-18T00:00:50.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8322025-07-18T00:00:50.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8332025-07-18T00:00:50.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8342025-07-18T00:00:50.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8352025-07-18T00:00:50.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8362025-07-18T00:00:50.255ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 334109649 } })
8372025-07-18T00:00:50.256ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
8382025-07-18T00:00:50.272ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8392025-07-18T00:00:50.272ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.149925ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8402025-07-18T00:00:50.275ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 59.78093ms iteration = 5 status = {"nsuccess":5}
8412025-07-18T00:00:50.284ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
8422025-07-18T00:00:50.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
8432025-07-18T00:00:50.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 90.520703ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
8442025-07-18T00:00:50.310ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8452025-07-18T00:00:50.310ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
8462025-07-18T00:00:50.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8472025-07-18T00:00:50.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8482025-07-18T00:00:50.312ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 93.018162ms iteration = 10 status = {"dispatched":[],"errors":[],"glob_version":"165.0.0","globs_reprocessed":{},"no_receivers":[]}
8492025-07-18T00:00:50.313ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8502025-07-18T00:00:50.313ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
8512025-07-18T00:00:50.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8522025-07-18T00:00:50.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8532025-07-18T00:00:50.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.301515ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8542025-07-18T00:00:50.323ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8552025-07-18T00:00:50.323ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 103.976011ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
8562025-07-18T00:00:50.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8572025-07-18T00:00:50.324ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8582025-07-18T00:00:50.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8592025-07-18T00:00:50.325ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
8602025-07-18T00:00:50.325ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2be4d985-6e68-40d2-a5d1-ba1e291e5f99 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
8612025-07-18T00:00:50.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8622025-07-18T00:00:50.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8632025-07-18T00:00:50.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 108.777274ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8642025-07-18T00:00:50.328ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8652025-07-18T00:00:50.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8662025-07-18T00:00:50.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8672025-07-18T00:00:50.331ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8682025-07-18T00:00:50.332ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
8692025-07-18T00:00:50.332ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
8702025-07-18T00:00:50.332ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 116.297121ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
8712025-07-18T00:00:50.333ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8722025-07-18T00:00:50.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8732025-07-18T00:00:50.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8742025-07-18T00:00:50.334ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8752025-07-18T00:00:50.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8762025-07-18T00:00:50.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
8772025-07-18T00:00:50.334ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8782025-07-18T00:00:50.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8792025-07-18T00:00:50.335ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8802025-07-18T00:00:50.335ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8812025-07-18T00:00:50.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8822025-07-18T00:00:50.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8832025-07-18T00:00:50.336ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:389
8842025-07-18T00:00:50.336ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 120.560876ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
8852025-07-18T00:00:50.337ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8862025-07-18T00:00:50.337ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2be4d985-6e68-40d2-a5d1-ba1e291e5f99 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
8872025-07-18T00:00:50.337ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
8882025-07-18T00:00:50.337ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-17 23:52:10.609253 UTC dns_group = internal generation = 1
8892025-07-18T00:00:50.337ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 133.116779ms iteration = 10 status = {"generation":1}
8902025-07-18T00:00:50.341ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
8912025-07-18T00:00:50.341ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8922025-07-18T00:00:50.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8932025-07-18T00:00:50.343ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8942025-07-18T00:00:50.347ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, lookup_type: ById(4a597d98-bd6a-42be-a09e-71b1fbba6de5) } result = Ok(())
8952025-07-18T00:00:50.347ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8962025-07-18T00:00:50.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8972025-07-18T00:00:50.354ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 138.856598ms iteration = 19 status = 0
8982025-07-18T00:00:50.356ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 140.165658ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8992025-07-18T00:00:50.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9002025-07-18T00:00:50.360ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
9012025-07-18T00:00:50.360ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a5c2ae61-5a10-495b-8726-f2f7ed24b4a0 dns_zone_name = oxide.test found_so_far = 0 version = 2
9022025-07-18T00:00:50.361ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9032025-07-18T00:00:50.361ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9042025-07-18T00:00:50.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9052025-07-18T00:00:50.364ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9062025-07-18T00:00:50.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9072025-07-18T00:00:50.364ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9082025-07-18T00:00:50.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
9092025-07-18T00:00:50.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9102025-07-18T00:00:50.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9112025-07-18T00:00:50.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9122025-07-18T00:00:50.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
9132025-07-18T00:00:50.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9142025-07-18T00:00:50.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9152025-07-18T00:00:50.372ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a5c2ae61-5a10-495b-8726-f2f7ed24b4a0 dns_zone_name = oxide.test found_so_far = 4 version = 2
9162025-07-18T00:00:50.372ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
9172025-07-18T00:00:50.372ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-17 23:52:11.153706 UTC dns_group = external generation = 2
9182025-07-18T00:00:50.372ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 165.728531ms iteration = 10 status = {"generation":2}
9192025-07-18T00:00:50.378ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9202025-07-18T00:00:50.378ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
9212025-07-18T00:00:50.379ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 163.228623ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
9222025-07-18T00:00:50.386ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
9232025-07-18T00:00:50.386ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9242025-07-18T00:00:50.386ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ac67f4c-9ab8-42e4-93ad-1f1bcd76aa36", "content-length": "26", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} })
9252025-07-18T00:00:50.386ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9262025-07-18T00:00:50.386ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
9272025-07-18T00:00:50.386ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 170.938272ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
9282025-07-18T00:00:50.387ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9292025-07-18T00:00:50.390ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
9302025-07-18T00:00:50.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9312025-07-18T00:00:50.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9322025-07-18T00:00:50.423ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-17T23:51:46.880014Z, time_modified: 2025-07-17T23:51:46.880014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f37123ec-61ff-4793-867b-6920b7f6246a, db_silo: Silo { identity: SiloIdentity { id: f37123ec-61ff-4793-867b-6920b7f6246a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-17T23:52:11.102986Z, time_modified: 2025-07-17T23:52:11.102986Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f37123ec-61ff-4793-867b-6920b7f6246a, db_silo: Silo { identity: SiloIdentity { id: f37123ec-61ff-4793-867b-6920b7f6246a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-17T23:52:11.102986Z, time_modified: 2025-07-17T23:52:11.102986Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3" }] }) }
9332025-07-18T00:00:50.423ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 215.852273ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f37123ec-61ff-4793-867b-6920b7f6246a","tls_certs":["6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3"]}},"default_endpoint":{"silo_id":"f37123ec-61ff-4793-867b-6920b7f6246a","tls_certs":["6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
9342025-07-18T00:00:50.430ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
9352025-07-18T00:00:50.432ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "87208aad-7c4b-4113-b421-147fddc7a81d", "content-length": "78", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} })
9362025-07-18T00:00:50.432ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
9372025-07-18T00:00:50.432ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
9382025-07-18T00:00:50.432ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
9392025-07-18T00:00:50.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
9402025-07-18T00:00:50.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
9412025-07-18T00:00:50.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
9422025-07-18T00:00:50.435ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
9432025-07-18T00:00:50.435ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
9442025-07-18T00:00:50.436ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
9452025-07-18T00:00:50.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
9462025-07-18T00:00:50.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
9472025-07-18T00:00:50.436ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
9482025-07-18T00:00:50.439ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
9492025-07-18T00:00:50.439ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
9502025-07-18T00:00:50.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
9512025-07-18T00:00:50.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
9522025-07-18T00:00:50.441ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
9532025-07-18T00:00:50.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
9542025-07-18T00:00:50.441ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 225.869017ms iteration = 21 status = {"physical_disks_added":0}
9552025-07-18T00:00:50.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
9562025-07-18T00:00:50.441ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
9572025-07-18T00:00:50.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
9582025-07-18T00:00:50.442ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
9592025-07-18T00:00:50.442ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
9602025-07-18T00:00:50.443ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b11a81d-ff6e-443c-94aa-fb51a392219b", "content-length": "81", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} })
9612025-07-18T00:00:50.444ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
9622025-07-18T00:00:50.444ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
9632025-07-18T00:00:50.444ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "60603e78-213b-4a51-9b6d-fe24aaa0793d", "content-length": "81", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} })
9642025-07-18T00:00:50.462ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 244.273281ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
9652025-07-18T00:00:50.483ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9662025-07-18T00:00:50.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9672025-07-18T00:00:50.485ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9682025-07-18T00:00:50.488ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9692025-07-18T00:00:50.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9702025-07-18T00:00:50.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9712025-07-18T00:00:50.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9722025-07-18T00:00:50.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9732025-07-18T00:00:50.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9742025-07-18T00:00:50.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9752025-07-18T00:00:50.498ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
9762025-07-18T00:00:50.498ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
9772025-07-18T00:00:50.498ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 zone_address = fd00:1122:3344:101::2
9782025-07-18T00:00:50.498ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9792025-07-18T00:00:50.499ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8a82d70-145c-4c67-82e7-cac3dc8ed518", "content-length": "81", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} })
9802025-07-18T00:00:50.499ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a110984-7dfc-4f06-b29c-09d834033047", "content-length": "26", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} })
9812025-07-18T00:00:50.499ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9822025-07-18T00:00:50.503ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
9832025-07-18T00:00:50.503ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 284.203926ms iteration = 19 status = {"errors":[],"sps":[]}
9842025-07-18T00:00:50.553ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
9852025-07-18T00:00:50.553ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9862025-07-18T00:00:50.554ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b81c0026-4008-4f6f-88a0-de022837d352", "content-length": "26", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} })
9872025-07-18T00:00:50.554ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9882025-07-18T00:00:50.556ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9892025-07-18T00:00:50.594ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9902025-07-18T00:00:50.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9912025-07-18T00:00:50.596ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 389.69482ms iteration = 19 status = null
9922025-07-18T00:00:50.597ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
9932025-07-18T00:00:50.597ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 382.022561ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
9942025-07-18T00:00:50.648ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
9952025-07-18T00:00:50.648ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d6b46cca-0468-4823-97d9-064826c6b3dc", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9962025-07-18T00:00:50.648ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9972025-07-18T00:00:50.650ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f08814d0-9394-46c8-8b57-43eb246f92a0", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9982025-07-18T00:00:50.650ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9992025-07-18T00:00:50.651ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
10002025-07-18T00:00:50.651ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 444.824538ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
10012025-07-18T00:00:50.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4f176bb6-dabb-4d38-8413-ff171bb1e699 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10022025-07-18T00:00:50.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4f176bb6-dabb-4d38-8413-ff171bb1e699 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10032025-07-18T00:00:50.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2518 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4f176bb6-dabb-4d38-8413-ff171bb1e699 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10042025-07-18T00:00:50.680ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
10052025-07-18T00:00:50.680ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f4c4cdc-da53-418c-8212-dfbedce7dbb3", "content-length": "691", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} })
10062025-07-18T00:00:50.680ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
10072025-07-18T00:00:50.680ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
10082025-07-18T00:00:50.681ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
10092025-07-18T00:00:50.681ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
10102025-07-18T00:00:50.683ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 467.273924ms iteration = 19 status = {}
10112025-07-18T00:00:50.702ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
10122025-07-18T00:00:50.703ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10132025-07-18T00:00:50.703ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a745de82-161f-4666-ab02-5db5672ef74b", "content-length": "372", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} })
10142025-07-18T00:00:50.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10152025-07-18T00:00:50.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10162025-07-18T00:00:50.715ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 508.549689ms iteration = 19 status = {}
10172025-07-18T00:00:50.719ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
10182025-07-18T00:00:50.719ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
10192025-07-18T00:00:50.720ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bf03458d-362a-4f8d-8ef9-b44fa8d37997", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} })
10202025-07-18T00:00:50.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10212025-07-18T00:00:50.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10222025-07-18T00:00:50.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10232025-07-18T00:00:50.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10242025-07-18T00:00:50.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10252025-07-18T00:00:50.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10262025-07-18T00:00:50.729ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
10272025-07-18T00:00:50.729ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10282025-07-18T00:00:50.729ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "172acbc2-442f-41b2-9c07-b33676c07626", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} })
10292025-07-18T00:00:50.731ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 515.662069ms iteration = 19 status = {}
10302025-07-18T00:00:50.758ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
10312025-07-18T00:00:50.759ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ff73ed03-4a65-4454-8d45-6cb57b0edd05", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
10322025-07-18T00:00:50.759ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
10332025-07-18T00:00:50.761ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d5050ec1-8965-4f0a-b9cc-21b97f85cd67", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
10342025-07-18T00:00:50.761ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
10352025-07-18T00:00:50.763ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8e0685a4-24f6-4819-a955-cfb79420b34d", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
10362025-07-18T00:00:50.763ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
10372025-07-18T00:00:50.765ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
10382025-07-18T00:00:50.765ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 558.442707ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
10392025-07-18T00:00:50.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10402025-07-18T00:00:50.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10412025-07-18T00:00:50.802ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a2d734dc-e0c9-4fd6-b442-f2c4e63791e5, rack_id: e4e73d6b-d53c-414c-93a8-eff1ed3c4807, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(9d790dba-5335-4b4c-be2a-58416dc1e8f5) } rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
10422025-07-18T00:00:50.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10432025-07-18T00:00:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10442025-07-18T00:00:50.813ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
10452025-07-18T00:00:50.813ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 9d790dba-5335-4b4c-be2a-58416dc1e8f5
10462025-07-18T00:00:50.813ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
10472025-07-18T00:00:50.813ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
10482025-07-18T00:00:50.813ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10492025-07-18T00:00:50.813ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10502025-07-18T00:00:50.813ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10512025-07-18T00:00:50.813ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10522025-07-18T00:00:50.813ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10532025-07-18T00:00:50.813ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10542025-07-18T00:00:50.813ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
10552025-07-18T00:00:50.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10562025-07-18T00:00:50.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10572025-07-18T00:00:50.816ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
10582025-07-18T00:00:50.816ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
10592025-07-18T00:00:50.922ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a3d307d1-df86-4f16-94c2-d5aecf255918", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} })
10602025-07-18T00:00:50.922ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch = Switch0
10612025-07-18T00:00:50.922ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
10622025-07-18T00:00:50.929ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f807c97-c6e4-41bd-abae-ecc9ac3ddc22", "content-length": "682", "date": "Fri, 18 Jul 2025 00:00:50 GMT"} })
10632025-07-18T00:00:50.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10642025-07-18T00:00:50.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10652025-07-18T00:00:50.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10662025-07-18T00:00:50.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10672025-07-18T00:00:50.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10682025-07-18T00:00:50.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10692025-07-18T00:00:50.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10702025-07-18T00:00:50.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10712025-07-18T00:00:50.944ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 729.032794ms iteration = 19 status = {}
10722025-07-18T00:00:50.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 212d58e9-d518-4cfa-b963-1414207f3d0d roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
10732025-07-18T00:00:50.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 212d58e9-d518-4cfa-b963-1414207f3d0d resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
10742025-07-18T00:00:50.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 212d58e9-d518-4cfa-b963-1414207f3d0d response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
10752025-07-18T00:00:50.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = bbc97f7a-7d7e-4bd3-9810-94016a8d178a roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
10762025-07-18T00:00:50.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = bbc97f7a-7d7e-4bd3-9810-94016a8d178a resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
10772025-07-18T00:00:50.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = bbc97f7a-7d7e-4bd3-9810-94016a8d178a response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
10782025-07-18T00:00:50.978ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 641 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = d9c2e8ba-bf22-49f3-a67a-2e6f235b9fc8 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
10792025-07-18T00:00:51.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8ad47ba1-7f8a-4338-ac99-6c9f3d4d3945 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10802025-07-18T00:00:51.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8ad47ba1-7f8a-4338-ac99-6c9f3d4d3945 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10812025-07-18T00:00:51.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8ad47ba1-7f8a-4338-ac99-6c9f3d4d3945 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10822025-07-18T00:00:52.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ba360c07-0f0b-4412-9bb5-fd2ec38823bc roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10832025-07-18T00:00:52.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ba360c07-0f0b-4412-9bb5-fd2ec38823bc resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10842025-07-18T00:00:52.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ba360c07-0f0b-4412-9bb5-fd2ec38823bc response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10852025-07-18T00:00:53.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48fe0f9c-5050-4c0f-a2d0-6fd38a2ad213 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10862025-07-18T00:00:53.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48fe0f9c-5050-4c0f-a2d0-6fd38a2ad213 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10872025-07-18T00:00:53.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48fe0f9c-5050-4c0f-a2d0-6fd38a2ad213 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10882025-07-18T00:00:54.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 725852be-6cc7-4afe-aee4-7d64af903ae3 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10892025-07-18T00:00:54.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 725852be-6cc7-4afe-aee4-7d64af903ae3 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10902025-07-18T00:00:54.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 725852be-6cc7-4afe-aee4-7d64af903ae3 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
10912025-07-18T00:00:55.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 110 reason = Timeout
10922025-07-18T00:00:55.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10932025-07-18T00:00:55.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10942025-07-18T00:00:55.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10952025-07-18T00:00:55.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
10962025-07-18T00:00:55.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10972025-07-18T00:00:55.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10982025-07-18T00:00:55.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
10992025-07-18T00:00:55.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.285702ms iteration = 110 status = {"chicken_switches_updated":false}
11002025-07-18T00:00:55.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e5b0bcd3-02bd-43bc-911d-37088b7ba970 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11012025-07-18T00:00:55.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e5b0bcd3-02bd-43bc-911d-37088b7ba970 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11022025-07-18T00:00:55.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e5b0bcd3-02bd-43bc-911d-37088b7ba970 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11032025-07-18T00:00:56.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1703b516-3bd5-48c4-b084-7a2a2a3c609a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11042025-07-18T00:00:56.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1703b516-3bd5-48c4-b084-7a2a2a3c609a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11052025-07-18T00:00:56.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1703b516-3bd5-48c4-b084-7a2a2a3c609a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11062025-07-18T00:00:57.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = cce01aee-1ec3-4960-84e9-a05c0383572b roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11072025-07-18T00:00:57.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = cce01aee-1ec3-4960-84e9-a05c0383572b resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11082025-07-18T00:00:57.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = cce01aee-1ec3-4960-84e9-a05c0383572b response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11092025-07-18T00:00:58.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8d501a2b-064c-42bc-8a16-ceccdc545ffd roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11102025-07-18T00:00:58.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8d501a2b-064c-42bc-8a16-ceccdc545ffd resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11112025-07-18T00:00:58.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8d501a2b-064c-42bc-8a16-ceccdc545ffd response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11122025-07-18T00:00:59.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f3b20f44-ffc7-40a5-b078-f0251bdc7194 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11132025-07-18T00:00:59.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f3b20f44-ffc7-40a5-b078-f0251bdc7194 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11142025-07-18T00:00:59.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f3b20f44-ffc7-40a5-b078-f0251bdc7194 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11152025-07-18T00:01:00.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 111 reason = Timeout
11162025-07-18T00:01:00.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11172025-07-18T00:01:00.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11182025-07-18T00:01:00.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11192025-07-18T00:01:00.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
11202025-07-18T00:01:00.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11212025-07-18T00:01:00.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11222025-07-18T00:01:00.215ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
11232025-07-18T00:01:00.215ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.101994ms iteration = 111 status = {"chicken_switches_updated":false}
11242025-07-18T00:01:00.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
11252025-07-18T00:01:00.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
11262025-07-18T00:01:00.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11272025-07-18T00:01:00.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11282025-07-18T00:01:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11292025-07-18T00:01:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11302025-07-18T00:01:00.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11312025-07-18T00:01:00.218ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11322025-07-18T00:01:00.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11332025-07-18T00:01:00.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.185764ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11342025-07-18T00:01:00.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11352025-07-18T00:01:00.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11362025-07-18T00:01:00.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11372025-07-18T00:01:00.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11382025-07-18T00:01:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11392025-07-18T00:01:00.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11402025-07-18T00:01:00.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
11412025-07-18T00:01:00.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11422025-07-18T00:01:00.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11432025-07-18T00:01:00.239ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
11442025-07-18T00:01:00.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.434221ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
11452025-07-18T00:01:00.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 92652edc-bef0-4ce2-825c-7bd3537a223e roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11462025-07-18T00:01:00.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 92652edc-bef0-4ce2-825c-7bd3537a223e resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11472025-07-18T00:01:00.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 92652edc-bef0-4ce2-825c-7bd3537a223e response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11482025-07-18T00:01:00.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 615 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 234e398e-d28c-45ad-b41e-ca6bde3db552 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
11492025-07-18T00:01:01.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 37ebcf03-c963-415b-8054-46c2b3e73c5c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11502025-07-18T00:01:01.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 37ebcf03-c963-415b-8054-46c2b3e73c5c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11512025-07-18T00:01:01.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 37ebcf03-c963-415b-8054-46c2b3e73c5c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11522025-07-18T00:01:02.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 305a9cc5-f6a1-44d2-bc92-d98747e810a9 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11532025-07-18T00:01:02.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 305a9cc5-f6a1-44d2-bc92-d98747e810a9 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11542025-07-18T00:01:02.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 305a9cc5-f6a1-44d2-bc92-d98747e810a9 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11552025-07-18T00:01:03.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2a64dc27-6078-4cbb-a3db-bcdabf2cfce7 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11562025-07-18T00:01:03.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2a64dc27-6078-4cbb-a3db-bcdabf2cfce7 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11572025-07-18T00:01:03.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2a64dc27-6078-4cbb-a3db-bcdabf2cfce7 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11582025-07-18T00:01:04.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 89c97fee-c6f1-4260-8848-d2724bbe57b8 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11592025-07-18T00:01:04.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 89c97fee-c6f1-4260-8848-d2724bbe57b8 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11602025-07-18T00:01:04.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 89c97fee-c6f1-4260-8848-d2724bbe57b8 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11612025-07-18T00:01:05.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 112 reason = Timeout
11622025-07-18T00:01:05.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11632025-07-18T00:01:05.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11642025-07-18T00:01:05.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11652025-07-18T00:01:05.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
11662025-07-18T00:01:05.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11672025-07-18T00:01:05.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11682025-07-18T00:01:05.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
11692025-07-18T00:01:05.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.808065ms iteration = 112 status = {"chicken_switches_updated":false}
11702025-07-18T00:01:05.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a60dbf9e-e281-4a7e-b30a-936eab139e0b roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11712025-07-18T00:01:05.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a60dbf9e-e281-4a7e-b30a-936eab139e0b resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11722025-07-18T00:01:05.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a60dbf9e-e281-4a7e-b30a-936eab139e0b response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11732025-07-18T00:01:06.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 372c212a-1035-46a8-b673-71c85347f646 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11742025-07-18T00:01:06.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 372c212a-1035-46a8-b673-71c85347f646 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11752025-07-18T00:01:06.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 372c212a-1035-46a8-b673-71c85347f646 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11762025-07-18T00:01:07.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1204339c-5562-4e30-9ede-3d9f186513aa roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11772025-07-18T00:01:07.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1204339c-5562-4e30-9ede-3d9f186513aa resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11782025-07-18T00:01:07.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1204339c-5562-4e30-9ede-3d9f186513aa response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11792025-07-18T00:01:08.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ee4222da-d3fa-4651-a02c-04e4e345fa61 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11802025-07-18T00:01:08.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ee4222da-d3fa-4651-a02c-04e4e345fa61 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11812025-07-18T00:01:08.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ee4222da-d3fa-4651-a02c-04e4e345fa61 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11822025-07-18T00:01:09.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8e8e8215-1fc1-45df-a6c6-319f021092b8 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11832025-07-18T00:01:09.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8e8e8215-1fc1-45df-a6c6-319f021092b8 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11842025-07-18T00:01:09.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8e8e8215-1fc1-45df-a6c6-319f021092b8 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
11852025-07-18T00:01:10.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 113 reason = Timeout
11862025-07-18T00:01:10.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11872025-07-18T00:01:10.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11882025-07-18T00:01:10.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11892025-07-18T00:01:10.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
11902025-07-18T00:01:10.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11912025-07-18T00:01:10.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11922025-07-18T00:01:10.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
11932025-07-18T00:01:10.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
11942025-07-18T00:01:10.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11952025-07-18T00:01:10.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11962025-07-18T00:01:10.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11972025-07-18T00:01:10.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11982025-07-18T00:01:10.215ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
11992025-07-18T00:01:10.215ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.267826ms iteration = 113 status = {"chicken_switches_updated":false}
12002025-07-18T00:01:10.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12012025-07-18T00:01:10.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12022025-07-18T00:01:10.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12032025-07-18T00:01:10.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.756708ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12042025-07-18T00:01:10.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12052025-07-18T00:01:10.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12062025-07-18T00:01:10.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12072025-07-18T00:01:10.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12082025-07-18T00:01:10.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12092025-07-18T00:01:10.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12102025-07-18T00:01:10.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
12112025-07-18T00:01:10.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12122025-07-18T00:01:10.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12132025-07-18T00:01:10.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
12142025-07-18T00:01:10.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.101915ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
12152025-07-18T00:01:10.978ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 562 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 7189aeea-7316-4b9b-8e58-2d7901bb562d response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
12162025-07-18T00:01:10.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0d39bdab-292e-4fdb-9d20-4bde26f30893 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12172025-07-18T00:01:10.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0d39bdab-292e-4fdb-9d20-4bde26f30893 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12182025-07-18T00:01:10.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0d39bdab-292e-4fdb-9d20-4bde26f30893 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12192025-07-18T00:01:12.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 20cab4bd-225b-4e2a-9261-b491195888c9 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12202025-07-18T00:01:12.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 20cab4bd-225b-4e2a-9261-b491195888c9 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12212025-07-18T00:01:12.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 20cab4bd-225b-4e2a-9261-b491195888c9 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12222025-07-18T00:01:13.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9548942e-f9f8-4861-8416-12ec6de947f7 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12232025-07-18T00:01:13.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9548942e-f9f8-4861-8416-12ec6de947f7 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12242025-07-18T00:01:13.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9548942e-f9f8-4861-8416-12ec6de947f7 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12252025-07-18T00:01:14.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 361305a0-84fd-4e28-8f24-940d21dff9cf roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12262025-07-18T00:01:14.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 361305a0-84fd-4e28-8f24-940d21dff9cf resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12272025-07-18T00:01:14.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 361305a0-84fd-4e28-8f24-940d21dff9cf response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12282025-07-18T00:01:15.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 04cce10c-32d3-441b-8864-922d28e63e82 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12292025-07-18T00:01:15.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 04cce10c-32d3-441b-8864-922d28e63e82 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12302025-07-18T00:01:15.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 04cce10c-32d3-441b-8864-922d28e63e82 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12312025-07-18T00:01:15.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 114 reason = Timeout
12322025-07-18T00:01:15.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
12332025-07-18T00:01:15.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
12342025-07-18T00:01:15.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12352025-07-18T00:01:15.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
12362025-07-18T00:01:15.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
12372025-07-18T00:01:15.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
12382025-07-18T00:01:15.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
12392025-07-18T00:01:15.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.724183ms iteration = 114 status = {"chicken_switches_updated":false}
12402025-07-18T00:01:16.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ee420232-1288-4dba-95a4-e35d3a3ef0fa roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12412025-07-18T00:01:16.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ee420232-1288-4dba-95a4-e35d3a3ef0fa resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12422025-07-18T00:01:16.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ee420232-1288-4dba-95a4-e35d3a3ef0fa response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12432025-07-18T00:01:17.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a93652bd-0be2-4979-a2fb-3d4dd0448b8d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12442025-07-18T00:01:17.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a93652bd-0be2-4979-a2fb-3d4dd0448b8d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12452025-07-18T00:01:17.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a93652bd-0be2-4979-a2fb-3d4dd0448b8d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12462025-07-18T00:01:18.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c4729fc0-4b49-461f-aa9d-f3c7bab3d292 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12472025-07-18T00:01:18.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c4729fc0-4b49-461f-aa9d-f3c7bab3d292 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12482025-07-18T00:01:18.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c4729fc0-4b49-461f-aa9d-f3c7bab3d292 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12492025-07-18T00:01:19.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f18bf3c0-0db5-4875-bf30-55d7f70e6b2f roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12502025-07-18T00:01:19.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f18bf3c0-0db5-4875-bf30-55d7f70e6b2f resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12512025-07-18T00:01:19.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f18bf3c0-0db5-4875-bf30-55d7f70e6b2f response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12522025-07-18T00:01:20.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1f8f9f1e-4633-4ad8-9ddd-347620f3f47c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12532025-07-18T00:01:20.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1f8f9f1e-4633-4ad8-9ddd-347620f3f47c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12542025-07-18T00:01:20.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1f8f9f1e-4633-4ad8-9ddd-347620f3f47c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
12552025-07-18T00:01:20.208ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
12562025-07-18T00:01:20.208ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
12572025-07-18T00:01:20.208ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12582025-07-18T00:01:20.208ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
12592025-07-18T00:01:20.208ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
12602025-07-18T00:01:20.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12612025-07-18T00:01:20.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12622025-07-18T00:01:20.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 115 reason = Timeout
12632025-07-18T00:01:20.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
12642025-07-18T00:01:20.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
12652025-07-18T00:01:20.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 288601898 } })
12662025-07-18T00:01:20.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
12672025-07-18T00:01:20.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 289248478 } })
12682025-07-18T00:01:20.212ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.782348ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12692025-07-18T00:01:20.212ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
12702025-07-18T00:01:20.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12712025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
12722025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
12732025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12742025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
12752025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12762025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
12772025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12782025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12792025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
12802025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
12812025-07-18T00:01:20.215ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
12822025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12832025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12842025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
12852025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12862025-07-18T00:01:20.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
12872025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
12882025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
12892025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
12902025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12912025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12922025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
12932025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
12942025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12952025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
12962025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12972025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12982025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
12992025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13002025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13012025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13022025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13032025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13042025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13052025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13062025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13072025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13082025-07-18T00:01:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13092025-07-18T00:01:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
13102025-07-18T00:01:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13112025-07-18T00:01:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
13122025-07-18T00:01:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13132025-07-18T00:01:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
13142025-07-18T00:01:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13152025-07-18T00:01:20.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13162025-07-18T00:01:20.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13172025-07-18T00:01:20.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13182025-07-18T00:01:20.219ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
13192025-07-18T00:01:20.219ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.713624ms iteration = 115 status = {"chicken_switches_updated":false}
13202025-07-18T00:01:20.219ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13212025-07-18T00:01:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13222025-07-18T00:01:20.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
13232025-07-18T00:01:20.219ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
13242025-07-18T00:01:20.219ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 20 reason = Timeout
13252025-07-18T00:01:20.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13262025-07-18T00:01:20.219ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
13272025-07-18T00:01:20.219ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13282025-07-18T00:01:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13292025-07-18T00:01:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
13302025-07-18T00:01:20.223ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 298149555 } })
13312025-07-18T00:01:20.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13322025-07-18T00:01:20.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13332025-07-18T00:01:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13342025-07-18T00:01:20.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13352025-07-18T00:01:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13362025-07-18T00:01:20.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13372025-07-18T00:01:20.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13382025-07-18T00:01:20.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13392025-07-18T00:01:20.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13402025-07-18T00:01:20.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13412025-07-18T00:01:20.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13422025-07-18T00:01:20.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13432025-07-18T00:01:20.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13442025-07-18T00:01:20.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13452025-07-18T00:01:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13462025-07-18T00:01:20.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13472025-07-18T00:01:20.231ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13482025-07-18T00:01:20.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13492025-07-18T00:01:20.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13502025-07-18T00:01:20.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13512025-07-18T00:01:20.233ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13522025-07-18T00:01:20.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13532025-07-18T00:01:20.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13542025-07-18T00:01:20.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13552025-07-18T00:01:20.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13562025-07-18T00:01:20.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13572025-07-18T00:01:20.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13582025-07-18T00:01:20.235ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13592025-07-18T00:01:20.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13602025-07-18T00:01:20.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.583642ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13612025-07-18T00:01:20.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.304776ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
13622025-07-18T00:01:20.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13632025-07-18T00:01:20.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13642025-07-18T00:01:20.244ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 322059873 } })
13652025-07-18T00:01:20.245ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
13662025-07-18T00:01:20.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13672025-07-18T00:01:20.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13682025-07-18T00:01:20.246ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13692025-07-18T00:01:20.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13702025-07-18T00:01:20.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13712025-07-18T00:01:20.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13722025-07-18T00:01:20.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 30.175234ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13732025-07-18T00:01:20.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13742025-07-18T00:01:20.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13752025-07-18T00:01:20.250ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13762025-07-18T00:01:20.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13772025-07-18T00:01:20.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13782025-07-18T00:01:20.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13792025-07-18T00:01:20.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13802025-07-18T00:01:20.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13812025-07-18T00:01:20.269ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 53.742337ms iteration = 22 status = {"physical_disks_added":0}
13822025-07-18T00:01:20.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13832025-07-18T00:01:20.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13842025-07-18T00:01:20.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13852025-07-18T00:01:20.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13862025-07-18T00:01:20.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13872025-07-18T00:01:20.276ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13882025-07-18T00:01:20.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13892025-07-18T00:01:20.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13902025-07-18T00:01:20.289ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13912025-07-18T00:01:20.289ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
13922025-07-18T00:01:20.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13932025-07-18T00:01:20.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13942025-07-18T00:01:20.292ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13952025-07-18T00:01:20.292ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13962025-07-18T00:01:20.292ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13972025-07-18T00:01:20.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13982025-07-18T00:01:20.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13992025-07-18T00:01:20.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
14002025-07-18T00:01:20.296ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14012025-07-18T00:01:20.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14022025-07-18T00:01:20.302ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14032025-07-18T00:01:20.302ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.176626ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14042025-07-18T00:01:20.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.835766ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
14052025-07-18T00:01:20.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.890879ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14062025-07-18T00:01:20.309ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
14072025-07-18T00:01:20.309ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.862016ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
14082025-07-18T00:01:20.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14092025-07-18T00:01:20.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14102025-07-18T00:01:20.311ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
14112025-07-18T00:01:20.311ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14122025-07-18T00:01:20.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14132025-07-18T00:01:20.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14142025-07-18T00:01:20.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14152025-07-18T00:01:20.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14162025-07-18T00:01:20.313ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14172025-07-18T00:01:20.314ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14182025-07-18T00:01:20.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14192025-07-18T00:01:20.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14202025-07-18T00:01:20.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14212025-07-18T00:01:20.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
14222025-07-18T00:01:20.316ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
14232025-07-18T00:01:20.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14242025-07-18T00:01:20.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14252025-07-18T00:01:20.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14262025-07-18T00:01:20.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, lookup_type: ById(4a597d98-bd6a-42be-a09e-71b1fbba6de5) } result = Ok(())
14272025-07-18T00:01:20.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14282025-07-18T00:01:20.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14292025-07-18T00:01:20.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14302025-07-18T00:01:20.323ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 107.877811ms iteration = 20 status = 0
14312025-07-18T00:01:20.325ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 106.363408ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
14322025-07-18T00:01:20.344ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14332025-07-18T00:01:20.344ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14342025-07-18T00:01:20.344ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.774343ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14352025-07-18T00:01:20.357ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
14362025-07-18T00:01:20.358ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "23081fec-2e25-4dda-b1b8-3ff1e6e117d1", "content-length": "78", "date": "Fri, 18 Jul 2025 00:01:20 GMT"} })
14372025-07-18T00:01:20.358ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
14382025-07-18T00:01:20.358ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
14392025-07-18T00:01:20.358ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
14402025-07-18T00:01:20.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
14412025-07-18T00:01:20.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
14422025-07-18T00:01:20.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
14432025-07-18T00:01:20.360ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
14442025-07-18T00:01:20.360ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:389
14452025-07-18T00:01:20.360ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 144.518695ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
14462025-07-18T00:01:20.360ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
14472025-07-18T00:01:20.361ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
14482025-07-18T00:01:20.361ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 143.052872ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
14492025-07-18T00:01:20.362ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
14502025-07-18T00:01:20.362ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
14512025-07-18T00:01:20.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
14522025-07-18T00:01:20.363ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
14532025-07-18T00:01:20.363ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
14542025-07-18T00:01:20.363ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
14552025-07-18T00:01:20.363ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
14562025-07-18T00:01:20.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
14572025-07-18T00:01:20.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
14582025-07-18T00:01:20.364ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
14592025-07-18T00:01:20.364ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
14602025-07-18T00:01:20.365ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "3153ffa6-b584-4a7e-8807-a74564187dd8", "content-length": "81", "date": "Fri, 18 Jul 2025 00:01:20 GMT"} })
14612025-07-18T00:01:20.392ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 zone_address = fd00:1122:3344:101::2
14622025-07-18T00:01:20.392ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14632025-07-18T00:01:20.392ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "faf1d10a-9d60-4e1c-abd3-a7a550f4aca0", "content-length": "26", "date": "Fri, 18 Jul 2025 00:01:20 GMT"} })
14642025-07-18T00:01:20.392ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14652025-07-18T00:01:20.394ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
14662025-07-18T00:01:20.408ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
14672025-07-18T00:01:20.408ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
14682025-07-18T00:01:20.408ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "67034237-8106-48f5-a69e-4e801a41808a", "content-length": "81", "date": "Fri, 18 Jul 2025 00:01:20 GMT"} })
14692025-07-18T00:01:20.410ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
14702025-07-18T00:01:20.410ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
14712025-07-18T00:01:20.410ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8d5a153-8425-4b71-bd78-dc7ae251ea9a", "content-length": "81", "date": "Fri, 18 Jul 2025 00:01:20 GMT"} })
14722025-07-18T00:01:20.412ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 192.91171ms iteration = 20 status = {"errors":[],"sps":[]}
14732025-07-18T00:01:20.432ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14742025-07-18T00:01:20.433ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd1d8528-cc3d-49d2-8720-4fe6c34e86a6", "content-length": "691", "date": "Fri, 18 Jul 2025 00:01:20 GMT"} })
14752025-07-18T00:01:20.433ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
14762025-07-18T00:01:20.433ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
14772025-07-18T00:01:20.433ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
14782025-07-18T00:01:20.435ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 219.495609ms iteration = 20 status = {}
14792025-07-18T00:01:20.459ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
14802025-07-18T00:01:20.459ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14812025-07-18T00:01:20.459ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "94e107b9-3d51-45c0-91b9-00beee468cde", "content-length": "26", "date": "Fri, 18 Jul 2025 00:01:20 GMT"} })
14822025-07-18T00:01:20.459ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14832025-07-18T00:01:20.461ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14842025-07-18T00:01:20.463ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
14852025-07-18T00:01:20.463ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14862025-07-18T00:01:20.463ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f913614b-f705-43b4-b609-16453276f9b8", "content-length": "26", "date": "Fri, 18 Jul 2025 00:01:20 GMT"} })
14872025-07-18T00:01:20.463ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14882025-07-18T00:01:20.465ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14892025-07-18T00:01:20.529ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
14902025-07-18T00:01:20.529ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14912025-07-18T00:01:20.529ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "88945e12-4cc8-4169-8754-f1ec048a088a", "content-length": "372", "date": "Fri, 18 Jul 2025 00:01:20 GMT"} })
14922025-07-18T00:01:20.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14932025-07-18T00:01:20.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14942025-07-18T00:01:20.551ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
14952025-07-18T00:01:20.551ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
14962025-07-18T00:01:20.552ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7018c566-7df7-44d9-9dd2-bc09851021f4", "date": "Fri, 18 Jul 2025 00:01:20 GMT"} })
14972025-07-18T00:01:20.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14982025-07-18T00:01:20.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14992025-07-18T00:01:20.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15002025-07-18T00:01:20.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15012025-07-18T00:01:20.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15022025-07-18T00:01:20.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15032025-07-18T00:01:20.562ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15042025-07-18T00:01:20.562ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15052025-07-18T00:01:20.568ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "74b0bf1b-4191-41f9-8167-0905d30bef7f", "date": "Fri, 18 Jul 2025 00:01:20 GMT"} })
15062025-07-18T00:01:20.571ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 355.205168ms iteration = 20 status = {}
15072025-07-18T00:01:20.582ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 374.383074ms iteration = 20 status = {}
15082025-07-18T00:01:20.640ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15092025-07-18T00:01:20.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15102025-07-18T00:01:20.642ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 433.952601ms iteration = 20 status = null
15112025-07-18T00:01:20.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15122025-07-18T00:01:20.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15132025-07-18T00:01:20.689ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a2d734dc-e0c9-4fd6-b442-f2c4e63791e5, rack_id: e4e73d6b-d53c-414c-93a8-eff1ed3c4807, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(9d790dba-5335-4b4c-be2a-58416dc1e8f5) } rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
15142025-07-18T00:01:20.689ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15152025-07-18T00:01:20.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15162025-07-18T00:01:20.702ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
15172025-07-18T00:01:20.702ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 9d790dba-5335-4b4c-be2a-58416dc1e8f5
15182025-07-18T00:01:20.702ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15192025-07-18T00:01:20.702ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15202025-07-18T00:01:20.702ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15212025-07-18T00:01:20.702ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15222025-07-18T00:01:20.702ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15232025-07-18T00:01:20.702ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15242025-07-18T00:01:20.702ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15252025-07-18T00:01:20.702ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15262025-07-18T00:01:20.703ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
15272025-07-18T00:01:20.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15282025-07-18T00:01:20.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15292025-07-18T00:01:20.705ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
15302025-07-18T00:01:20.705ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15312025-07-18T00:01:20.812ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "624c6244-e2a3-4097-a47a-c739cd80eccb", "date": "Fri, 18 Jul 2025 00:01:20 GMT"} })
15322025-07-18T00:01:20.812ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch = Switch0
15332025-07-18T00:01:20.812ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15342025-07-18T00:01:20.819ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "aec61b0f-b8c9-45ff-b2be-6a79713c820f", "content-length": "682", "date": "Fri, 18 Jul 2025 00:01:20 GMT"} })
15352025-07-18T00:01:20.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15362025-07-18T00:01:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15372025-07-18T00:01:20.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15382025-07-18T00:01:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15392025-07-18T00:01:20.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15402025-07-18T00:01:20.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15412025-07-18T00:01:20.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15422025-07-18T00:01:20.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15432025-07-18T00:01:20.838ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 622.447333ms iteration = 20 status = {}
15442025-07-18T00:01:20.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 2c491ff1-9171-456d-9132-4cdc6c13efeb roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
15452025-07-18T00:01:20.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 2c491ff1-9171-456d-9132-4cdc6c13efeb resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
15462025-07-18T00:01:20.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 2c491ff1-9171-456d-9132-4cdc6c13efeb response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
15472025-07-18T00:01:20.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = fe2c4dcc-0dbf-45a9-88b3-9fd1d1288e16 roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
15482025-07-18T00:01:20.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = fe2c4dcc-0dbf-45a9-88b3-9fd1d1288e16 resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
15492025-07-18T00:01:20.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = fe2c4dcc-0dbf-45a9-88b3-9fd1d1288e16 response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
15502025-07-18T00:01:20.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 474 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = c51b8d2c-74bc-4201-b3c5-ac662194abdf response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
15512025-07-18T00:01:21.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a2c4b67c-d3e0-44d1-a15b-fcd3e057a9ce roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15522025-07-18T00:01:21.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a2c4b67c-d3e0-44d1-a15b-fcd3e057a9ce resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15532025-07-18T00:01:21.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a2c4b67c-d3e0-44d1-a15b-fcd3e057a9ce response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15542025-07-18T00:01:22.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9c9a5976-126c-4339-9521-f7b6df36e510 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15552025-07-18T00:01:22.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9c9a5976-126c-4339-9521-f7b6df36e510 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15562025-07-18T00:01:22.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9c9a5976-126c-4339-9521-f7b6df36e510 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15572025-07-18T00:01:23.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a00a66eb-1193-4585-9021-6c81d645d72d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15582025-07-18T00:01:23.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a00a66eb-1193-4585-9021-6c81d645d72d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15592025-07-18T00:01:23.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a00a66eb-1193-4585-9021-6c81d645d72d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15602025-07-18T00:01:24.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = caac5c0b-1e9d-48b7-b961-cf3c22e81139 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15612025-07-18T00:01:24.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = caac5c0b-1e9d-48b7-b961-cf3c22e81139 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15622025-07-18T00:01:24.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = caac5c0b-1e9d-48b7-b961-cf3c22e81139 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15632025-07-18T00:01:25.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 116 reason = Timeout
15642025-07-18T00:01:25.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
15652025-07-18T00:01:25.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
15662025-07-18T00:01:25.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15672025-07-18T00:01:25.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
15682025-07-18T00:01:25.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
15692025-07-18T00:01:25.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
15702025-07-18T00:01:25.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
15712025-07-18T00:01:25.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 5.983813ms iteration = 116 status = {"chicken_switches_updated":false}
15722025-07-18T00:01:25.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 86ccb2d7-01c8-463c-b600-57199f5ac694 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15732025-07-18T00:01:25.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 86ccb2d7-01c8-463c-b600-57199f5ac694 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15742025-07-18T00:01:25.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 86ccb2d7-01c8-463c-b600-57199f5ac694 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15752025-07-18T00:01:26.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 56415859-bc0b-42af-be49-ce52741303aa roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15762025-07-18T00:01:26.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 56415859-bc0b-42af-be49-ce52741303aa resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15772025-07-18T00:01:26.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 56415859-bc0b-42af-be49-ce52741303aa response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15782025-07-18T00:01:27.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6a661a94-f425-41d7-b9a8-eedb482d0c13 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15792025-07-18T00:01:27.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6a661a94-f425-41d7-b9a8-eedb482d0c13 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15802025-07-18T00:01:27.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6a661a94-f425-41d7-b9a8-eedb482d0c13 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15812025-07-18T00:01:28.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 45aa5cd8-f305-4df6-9ca6-0bf9ee52b7f0 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15822025-07-18T00:01:28.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 45aa5cd8-f305-4df6-9ca6-0bf9ee52b7f0 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15832025-07-18T00:01:28.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 45aa5cd8-f305-4df6-9ca6-0bf9ee52b7f0 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15842025-07-18T00:01:29.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0409f2aa-ab18-4af2-b26b-7d56e213df22 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15852025-07-18T00:01:29.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0409f2aa-ab18-4af2-b26b-7d56e213df22 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15862025-07-18T00:01:29.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0409f2aa-ab18-4af2-b26b-7d56e213df22 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
15872025-07-18T00:01:30.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 117 reason = Timeout
15882025-07-18T00:01:30.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
15892025-07-18T00:01:30.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
15902025-07-18T00:01:30.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15912025-07-18T00:01:30.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
15922025-07-18T00:01:30.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
15932025-07-18T00:01:30.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
15942025-07-18T00:01:30.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
15952025-07-18T00:01:30.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
15962025-07-18T00:01:30.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15972025-07-18T00:01:30.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15982025-07-18T00:01:30.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15992025-07-18T00:01:30.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16002025-07-18T00:01:30.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
16012025-07-18T00:01:30.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.539651ms iteration = 117 status = {"chicken_switches_updated":false}
16022025-07-18T00:01:30.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16032025-07-18T00:01:30.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16042025-07-18T00:01:30.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16052025-07-18T00:01:30.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.036612ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16062025-07-18T00:01:30.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16072025-07-18T00:01:30.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16082025-07-18T00:01:30.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16092025-07-18T00:01:30.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16102025-07-18T00:01:30.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16112025-07-18T00:01:30.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16122025-07-18T00:01:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
16132025-07-18T00:01:30.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16142025-07-18T00:01:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16152025-07-18T00:01:30.238ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
16162025-07-18T00:01:30.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.464151ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
16172025-07-18T00:01:30.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3e1c2abd-18f7-44de-af64-ea14dfc157b4 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16182025-07-18T00:01:30.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3e1c2abd-18f7-44de-af64-ea14dfc157b4 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16192025-07-18T00:01:30.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3e1c2abd-18f7-44de-af64-ea14dfc157b4 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16202025-07-18T00:01:30.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 540 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 33d9b06c-7c8e-4a69-ac08-9b3635aa9be4 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
16212025-07-18T00:01:31.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2713ddee-7159-4044-90c6-d9c63de0ec4c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16222025-07-18T00:01:31.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2713ddee-7159-4044-90c6-d9c63de0ec4c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16232025-07-18T00:01:31.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2713ddee-7159-4044-90c6-d9c63de0ec4c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16242025-07-18T00:01:32.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f51d43c5-b947-441c-bb93-67c4360d1a1c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16252025-07-18T00:01:32.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f51d43c5-b947-441c-bb93-67c4360d1a1c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16262025-07-18T00:01:32.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f51d43c5-b947-441c-bb93-67c4360d1a1c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16272025-07-18T00:01:33.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9eddbe9a-431b-4a30-b69e-b1f664fe8d6a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16282025-07-18T00:01:33.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9eddbe9a-431b-4a30-b69e-b1f664fe8d6a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16292025-07-18T00:01:33.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9eddbe9a-431b-4a30-b69e-b1f664fe8d6a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16302025-07-18T00:01:34.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b017b2c5-7874-43fb-a9bd-6b98e343e8f8 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16312025-07-18T00:01:34.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b017b2c5-7874-43fb-a9bd-6b98e343e8f8 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16322025-07-18T00:01:34.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b017b2c5-7874-43fb-a9bd-6b98e343e8f8 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16332025-07-18T00:01:35.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 118 reason = Timeout
16342025-07-18T00:01:35.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16352025-07-18T00:01:35.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16362025-07-18T00:01:35.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16372025-07-18T00:01:35.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
16382025-07-18T00:01:35.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16392025-07-18T00:01:35.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16402025-07-18T00:01:35.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
16412025-07-18T00:01:35.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.351778ms iteration = 118 status = {"chicken_switches_updated":false}
16422025-07-18T00:01:35.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ef2a3dd1-405b-48d0-a671-748b4b6142f2 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16432025-07-18T00:01:35.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ef2a3dd1-405b-48d0-a671-748b4b6142f2 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16442025-07-18T00:01:35.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ef2a3dd1-405b-48d0-a671-748b4b6142f2 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16452025-07-18T00:01:36.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a9d51eef-0908-4da8-95fd-fe6b7c2dcf48 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16462025-07-18T00:01:36.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a9d51eef-0908-4da8-95fd-fe6b7c2dcf48 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16472025-07-18T00:01:36.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a9d51eef-0908-4da8-95fd-fe6b7c2dcf48 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16482025-07-18T00:01:37.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7101a1f5-69f2-4368-893b-ef48deebfd19 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16492025-07-18T00:01:37.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7101a1f5-69f2-4368-893b-ef48deebfd19 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16502025-07-18T00:01:37.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7101a1f5-69f2-4368-893b-ef48deebfd19 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16512025-07-18T00:01:38.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 98e00167-89b1-482e-91ca-b4842f0d0a59 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16522025-07-18T00:01:38.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 98e00167-89b1-482e-91ca-b4842f0d0a59 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16532025-07-18T00:01:38.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 98e00167-89b1-482e-91ca-b4842f0d0a59 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16542025-07-18T00:01:39.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = fb18af48-e31b-4805-a3bf-fbfe3634d3d2 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16552025-07-18T00:01:39.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = fb18af48-e31b-4805-a3bf-fbfe3634d3d2 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16562025-07-18T00:01:39.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = fb18af48-e31b-4805-a3bf-fbfe3634d3d2 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16572025-07-18T00:01:40.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 119 reason = Timeout
16582025-07-18T00:01:40.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16592025-07-18T00:01:40.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16602025-07-18T00:01:40.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16612025-07-18T00:01:40.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
16622025-07-18T00:01:40.213ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16632025-07-18T00:01:40.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16642025-07-18T00:01:40.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
16652025-07-18T00:01:40.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
16662025-07-18T00:01:40.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16672025-07-18T00:01:40.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16682025-07-18T00:01:40.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16692025-07-18T00:01:40.215ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
16702025-07-18T00:01:40.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16712025-07-18T00:01:40.215ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.240746ms iteration = 119 status = {"chicken_switches_updated":false}
16722025-07-18T00:01:40.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16732025-07-18T00:01:40.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16742025-07-18T00:01:40.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16752025-07-18T00:01:40.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.563244ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16762025-07-18T00:01:40.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16772025-07-18T00:01:40.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16782025-07-18T00:01:40.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16792025-07-18T00:01:40.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16802025-07-18T00:01:40.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16812025-07-18T00:01:40.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16822025-07-18T00:01:40.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
16832025-07-18T00:01:40.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16842025-07-18T00:01:40.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16852025-07-18T00:01:40.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
16862025-07-18T00:01:40.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.889181ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
16872025-07-18T00:01:40.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = aedfecc2-3f12-4b58-9016-9392cfd9c886 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16882025-07-18T00:01:40.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = aedfecc2-3f12-4b58-9016-9392cfd9c886 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16892025-07-18T00:01:40.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = aedfecc2-3f12-4b58-9016-9392cfd9c886 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16902025-07-18T00:01:40.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 575 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 2e3dcc2d-43c8-468c-aabe-e90376eb913b response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
16912025-07-18T00:01:41.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1b72da4d-9ade-41ea-8119-e421c321757a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16922025-07-18T00:01:41.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1b72da4d-9ade-41ea-8119-e421c321757a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16932025-07-18T00:01:41.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1b72da4d-9ade-41ea-8119-e421c321757a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16942025-07-18T00:01:42.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a94b35c7-29f2-42ec-a2ad-cdc6e42d85a9 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16952025-07-18T00:01:42.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a94b35c7-29f2-42ec-a2ad-cdc6e42d85a9 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16962025-07-18T00:01:42.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a94b35c7-29f2-42ec-a2ad-cdc6e42d85a9 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16972025-07-18T00:01:43.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 84df9f3a-bdef-4d4b-9787-d908a7b694c1 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16982025-07-18T00:01:43.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 84df9f3a-bdef-4d4b-9787-d908a7b694c1 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
16992025-07-18T00:01:43.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 84df9f3a-bdef-4d4b-9787-d908a7b694c1 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17002025-07-18T00:01:44.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 63ea61c7-7449-4475-b3f4-b33a3b2ebb90 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17012025-07-18T00:01:44.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 63ea61c7-7449-4475-b3f4-b33a3b2ebb90 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17022025-07-18T00:01:44.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 63ea61c7-7449-4475-b3f4-b33a3b2ebb90 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17032025-07-18T00:01:45.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 120 reason = Timeout
17042025-07-18T00:01:45.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
17052025-07-18T00:01:45.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
17062025-07-18T00:01:45.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17072025-07-18T00:01:45.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
17082025-07-18T00:01:45.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
17092025-07-18T00:01:45.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
17102025-07-18T00:01:45.215ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
17112025-07-18T00:01:45.215ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.124624ms iteration = 120 status = {"chicken_switches_updated":false}
17122025-07-18T00:01:45.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d9da0a2f-ec02-4787-89fd-2482c962fb3b roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17132025-07-18T00:01:45.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d9da0a2f-ec02-4787-89fd-2482c962fb3b resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17142025-07-18T00:01:45.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d9da0a2f-ec02-4787-89fd-2482c962fb3b response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17152025-07-18T00:01:46.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8c9bd09c-763a-4227-96e0-f86d39362279 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17162025-07-18T00:01:46.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8c9bd09c-763a-4227-96e0-f86d39362279 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17172025-07-18T00:01:46.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8c9bd09c-763a-4227-96e0-f86d39362279 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17182025-07-18T00:01:47.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6991f1d7-ea88-4891-ac08-b9a8eefbf28c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17192025-07-18T00:01:47.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6991f1d7-ea88-4891-ac08-b9a8eefbf28c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17202025-07-18T00:01:47.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6991f1d7-ea88-4891-ac08-b9a8eefbf28c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17212025-07-18T00:01:48.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 224c10f9-ef32-4d4a-9261-27fbcfd01b15 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17222025-07-18T00:01:48.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 224c10f9-ef32-4d4a-9261-27fbcfd01b15 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17232025-07-18T00:01:48.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 224c10f9-ef32-4d4a-9261-27fbcfd01b15 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17242025-07-18T00:01:49.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4ce879c3-8294-4834-99c4-ded133bdf85d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17252025-07-18T00:01:49.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4ce879c3-8294-4834-99c4-ded133bdf85d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17262025-07-18T00:01:49.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4ce879c3-8294-4834-99c4-ded133bdf85d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
17272025-07-18T00:01:50.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
17282025-07-18T00:01:50.205ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
17292025-07-18T00:01:50.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17302025-07-18T00:01:50.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17312025-07-18T00:01:50.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17322025-07-18T00:01:50.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17332025-07-18T00:01:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
17342025-07-18T00:01:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
17352025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
17362025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17372025-07-18T00:01:50.208ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-17 23:51:50.208027412 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
17382025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
17392025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
17402025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
17412025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17422025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
17432025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
17442025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
17452025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
17462025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17472025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17482025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
17492025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
17502025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17512025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
17522025-07-18T00:01:50.208ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 9092da00-a622-42cf-99af-453ea64d4a35
17532025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.9\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"9092da00-a622-42cf-99af-453ea64d4a35"}
17542025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17552025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
17562025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17572025-07-18T00:01:50.208ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("56b8d8b3-74d8-49ff-9bba-ff575bfeff38.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b6789fb-7f6d-466d-9e8d-08234eb15cb4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eee78e3b-9d92-4bbf-a496-9511487338e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("eee78e3b-9d92-4bbf-a496-9511487338e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:3::1)) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 286324793 } })
17582025-07-18T00:01:50.208ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("464a3447-fe1f-417e-b585-925f5fb5bfdc.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da3261f0-45ba-4fbf-b6bb-a5a70850db80.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("da3261f0-45ba-4fbf-b6bb-a5a70850db80.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 286333263 } })
17592025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17602025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17612025-07-18T00:01:50.208ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
17622025-07-18T00:01:50.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.030036ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
17632025-07-18T00:01:50.209ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
17642025-07-18T00:01:50.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.066776ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
17652025-07-18T00:01:50.210ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
17662025-07-18T00:01:50.210ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 14 reason = Timeout
17672025-07-18T00:01:50.210ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
17682025-07-18T00:01:50.210ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 5.64\u{b5}s iteration = 14 status = "Disabled"
17692025-07-18T00:01:50.210ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17702025-07-18T00:01:50.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 121 reason = Timeout
17712025-07-18T00:01:50.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
17722025-07-18T00:01:50.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17732025-07-18T00:01:50.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
17742025-07-18T00:01:50.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17752025-07-18T00:01:50.211ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-17 23:51:50.208027412 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
17762025-07-18T00:01:50.211ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.002856ms iteration = 11 status = {"expiration":"2025-07-17T23:51:50.208027412Z","pruned":[]}
17772025-07-18T00:01:50.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 288934823 } })
17782025-07-18T00:01:50.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17792025-07-18T00:01:50.211ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17802025-07-18T00:01:50.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
17812025-07-18T00:01:50.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 289282458 } })
17822025-07-18T00:01:50.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
17832025-07-18T00:01:50.212ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.219985ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17842025-07-18T00:01:50.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17852025-07-18T00:01:50.212ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17862025-07-18T00:01:50.212ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17872025-07-18T00:01:50.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17882025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17892025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17902025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17912025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
17922025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
17932025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
17942025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
17952025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17962025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17972025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
17982025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17992025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
18002025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18012025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
18022025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18032025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
18042025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
18052025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
18062025-07-18T00:01:50.215ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
18072025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18082025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
18092025-07-18T00:01:50.215ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
18102025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18112025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
18122025-07-18T00:01:50.215ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18132025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18142025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
18152025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18162025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
18172025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18182025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
18192025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18202025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
18212025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18222025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
18232025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18242025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18252025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
18262025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18272025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
18282025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18292025-07-18T00:01:50.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18302025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
18312025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18322025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
18332025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18342025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18352025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18362025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
18372025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18382025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18392025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18402025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18412025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18422025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18432025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18442025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18452025-07-18T00:01:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18462025-07-18T00:01:50.217ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18472025-07-18T00:01:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18482025-07-18T00:01:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
18492025-07-18T00:01:50.218ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
18502025-07-18T00:01:50.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18512025-07-18T00:01:50.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18522025-07-18T00:01:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
18532025-07-18T00:01:50.218ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18542025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
18552025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18562025-07-18T00:01:50.219ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
18572025-07-18T00:01:50.219ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
18582025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
18592025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
18602025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18612025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
18622025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
18632025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18642025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18652025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
18662025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18672025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
18682025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18692025-07-18T00:01:50.219ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
18702025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18712025-07-18T00:01:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18722025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
18732025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
18742025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18752025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
18762025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
18772025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
18782025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 21 reason = Timeout
18792025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 11 reason = Timeout
18802025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
18812025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 11 reason = Timeout
18822025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
18832025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18842025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
18852025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18862025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
18872025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
18882025-07-18T00:01:50.220ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 298474910 } })
18892025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
18902025-07-18T00:01:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
18912025-07-18T00:01:50.221ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
18922025-07-18T00:01:50.221ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
18932025-07-18T00:01:50.221ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.639187ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
18942025-07-18T00:01:50.222ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18952025-07-18T00:01:50.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18962025-07-18T00:01:50.222ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18972025-07-18T00:01:50.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18982025-07-18T00:01:50.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18992025-07-18T00:01:50.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
19002025-07-18T00:01:50.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
19012025-07-18T00:01:50.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
19022025-07-18T00:01:50.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19032025-07-18T00:01:50.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19042025-07-18T00:01:50.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19052025-07-18T00:01:50.225ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19062025-07-18T00:01:50.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19072025-07-18T00:01:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
19082025-07-18T00:01:50.226ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19092025-07-18T00:01:50.226ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19102025-07-18T00:01:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19112025-07-18T00:01:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19122025-07-18T00:01:50.228ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19132025-07-18T00:01:50.228ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
19142025-07-18T00:01:50.228ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 18.251981ms iteration = 121 status = {"chicken_switches_updated":false}
19152025-07-18T00:01:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19162025-07-18T00:01:50.229ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.659354ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
19172025-07-18T00:01:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19182025-07-18T00:01:50.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19192025-07-18T00:01:50.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19202025-07-18T00:01:50.230ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(434504ca-585c-4496-b93b-17ff4433d516, 0), (9d5274a9-bbd9-4af0-aa29-90cf0978f221, 0), (65847ff3-68d8-4df2-a4d6-fdb0f14fc4a1, 0), (78d39801-5737-4991-a5a6-1abe7d8457d5, 0)] collection_id = 434504ca-585c-4496-b93b-17ff4433d516
19212025-07-18T00:01:50.230ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
19222025-07-18T00:01:50.230ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19232025-07-18T00:01:50.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
19242025-07-18T00:01:50.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
19252025-07-18T00:01:50.231ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19262025-07-18T00:01:50.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19272025-07-18T00:01:50.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19282025-07-18T00:01:50.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19292025-07-18T00:01:50.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19302025-07-18T00:01:50.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19312025-07-18T00:01:50.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19322025-07-18T00:01:50.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19332025-07-18T00:01:50.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19342025-07-18T00:01:50.254ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19352025-07-18T00:01:50.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19362025-07-18T00:01:50.259ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
19372025-07-18T00:01:50.260ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 39.754692ms iteration = 11 status = {"by_rx":{},"error":null}
19382025-07-18T00:01:50.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19392025-07-18T00:01:50.262ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
19402025-07-18T00:01:50.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19412025-07-18T00:01:50.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
19422025-07-18T00:01:50.264ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
19432025-07-18T00:01:50.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
19442025-07-18T00:01:50.269ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 347315082 } })
19452025-07-18T00:01:50.270ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
19462025-07-18T00:01:50.271ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19472025-07-18T00:01:50.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19482025-07-18T00:01:50.274ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19492025-07-18T00:01:50.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19502025-07-18T00:01:50.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19512025-07-18T00:01:50.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19522025-07-18T00:01:50.279ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19532025-07-18T00:01:50.283ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19542025-07-18T00:01:50.283ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19552025-07-18T00:01:50.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19562025-07-18T00:01:50.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19572025-07-18T00:01:50.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19582025-07-18T00:01:50.295ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
19592025-07-18T00:01:50.295ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
19602025-07-18T00:01:50.295ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
19612025-07-18T00:01:50.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19622025-07-18T00:01:50.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19632025-07-18T00:01:50.296ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19642025-07-18T00:01:50.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19652025-07-18T00:01:50.300ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19662025-07-18T00:01:50.302ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
19672025-07-18T00:01:50.302ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
19682025-07-18T00:01:50.302ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
19692025-07-18T00:01:50.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19702025-07-18T00:01:50.302ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
19712025-07-18T00:01:50.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19722025-07-18T00:01:50.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
19732025-07-18T00:01:50.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19742025-07-18T00:01:50.304ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19752025-07-18T00:01:50.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19762025-07-18T00:01:50.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 88.650554ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
19772025-07-18T00:01:50.308ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
19782025-07-18T00:01:50.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
19792025-07-18T00:01:50.309ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19802025-07-18T00:01:50.309ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19812025-07-18T00:01:50.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19822025-07-18T00:01:50.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19832025-07-18T00:01:50.310ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19842025-07-18T00:01:50.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19852025-07-18T00:01:50.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
19862025-07-18T00:01:50.314ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19872025-07-18T00:01:50.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 95.288567ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
19882025-07-18T00:01:50.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19892025-07-18T00:01:50.316ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19902025-07-18T00:01:50.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19912025-07-18T00:01:50.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19922025-07-18T00:01:50.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19932025-07-18T00:01:50.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19942025-07-18T00:01:50.319ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 99.705505ms iteration = 11 status = {"dispatched":[],"errors":[],"glob_version":"165.0.0","globs_reprocessed":{},"no_receivers":[]}
19952025-07-18T00:01:50.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
19962025-07-18T00:01:50.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19972025-07-18T00:01:50.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19982025-07-18T00:01:50.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19992025-07-18T00:01:50.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20002025-07-18T00:01:50.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20012025-07-18T00:01:50.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20022025-07-18T00:01:50.326ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20032025-07-18T00:01:50.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20042025-07-18T00:01:50.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20052025-07-18T00:01:50.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20062025-07-18T00:01:50.329ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
20072025-07-18T00:01:50.329ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 110.552162ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
20082025-07-18T00:01:50.329ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20092025-07-18T00:01:50.329ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20102025-07-18T00:01:50.329ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20112025-07-18T00:01:50.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20122025-07-18T00:01:50.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
20132025-07-18T00:01:50.330ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20142025-07-18T00:01:50.330ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 110.298129ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
20152025-07-18T00:01:50.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20162025-07-18T00:01:50.330ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 115.304365ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20172025-07-18T00:01:50.331ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20182025-07-18T00:01:50.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20192025-07-18T00:01:50.336ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20202025-07-18T00:01:50.337ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 117.531689ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
20212025-07-18T00:01:50.340ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
20222025-07-18T00:01:50.340ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
20232025-07-18T00:01:50.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
20242025-07-18T00:01:50.347ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20252025-07-18T00:01:50.347ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 131.920661ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20262025-07-18T00:01:50.351ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
20272025-07-18T00:01:50.351ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 136.207317ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
20282025-07-18T00:01:50.354ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
20292025-07-18T00:01:50.354ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
20302025-07-18T00:01:50.354ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 138.959639ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
20312025-07-18T00:01:50.379ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 160.216677ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20322025-07-18T00:01:50.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
20332025-07-18T00:01:50.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
20342025-07-18T00:01:50.386ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20352025-07-18T00:01:50.386ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20362025-07-18T00:01:50.386ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 170.80583ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20372025-07-18T00:01:50.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20382025-07-18T00:01:50.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20392025-07-18T00:01:50.394ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 179.260079ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20402025-07-18T00:01:50.395ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20412025-07-18T00:01:50.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20422025-07-18T00:01:50.397ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:389
20432025-07-18T00:01:50.397ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 181.8815ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
20442025-07-18T00:01:50.399ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 184.174405ms iteration = 23 status = {"physical_disks_added":0}
20452025-07-18T00:01:50.400ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20462025-07-18T00:01:50.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, lookup_type: ById(4a597d98-bd6a-42be-a09e-71b1fbba6de5) } result = Ok(())
20472025-07-18T00:01:50.406ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20482025-07-18T00:01:50.407ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
20492025-07-18T00:01:50.407ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2be4d985-6e68-40d2-a5d1-ba1e291e5f99 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
20502025-07-18T00:01:50.407ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20512025-07-18T00:01:50.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20522025-07-18T00:01:50.407ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
20532025-07-18T00:01:50.407ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a5c2ae61-5a10-495b-8726-f2f7ed24b4a0 dns_zone_name = oxide.test found_so_far = 0 version = 2
20542025-07-18T00:01:50.407ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20552025-07-18T00:01:50.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20562025-07-18T00:01:50.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20572025-07-18T00:01:50.409ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20582025-07-18T00:01:50.410ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 194.584746ms iteration = 21 status = 0
20592025-07-18T00:01:50.415ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20602025-07-18T00:01:50.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20612025-07-18T00:01:50.420ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20622025-07-18T00:01:50.420ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20632025-07-18T00:01:50.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20642025-07-18T00:01:50.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20652025-07-18T00:01:50.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20662025-07-18T00:01:50.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20672025-07-18T00:01:50.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20682025-07-18T00:01:50.424ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20692025-07-18T00:01:50.424ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2be4d985-6e68-40d2-a5d1-ba1e291e5f99 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
20702025-07-18T00:01:50.424ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20712025-07-18T00:01:50.424ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-17 23:52:10.609253 UTC dns_group = internal generation = 1
20722025-07-18T00:01:50.424ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 219.437888ms iteration = 11 status = {"generation":1}
20732025-07-18T00:01:50.424ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a5c2ae61-5a10-495b-8726-f2f7ed24b4a0 dns_zone_name = oxide.test found_so_far = 4 version = 2
20742025-07-18T00:01:50.424ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
20752025-07-18T00:01:50.424ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-17 23:52:11.153706 UTC dns_group = external generation = 2
20762025-07-18T00:01:50.424ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 216.849768ms iteration = 11 status = {"generation":2}
20772025-07-18T00:01:50.427ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20782025-07-18T00:01:50.427ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20792025-07-18T00:01:50.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20802025-07-18T00:01:50.429ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20812025-07-18T00:01:50.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20822025-07-18T00:01:50.431ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20832025-07-18T00:01:50.436ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20842025-07-18T00:01:50.439ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
20852025-07-18T00:01:50.439ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
20862025-07-18T00:01:50.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
20872025-07-18T00:01:50.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
20882025-07-18T00:01:50.441ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20892025-07-18T00:01:50.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20902025-07-18T00:01:50.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20912025-07-18T00:01:50.469ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
20922025-07-18T00:01:50.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
20932025-07-18T00:01:50.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
20942025-07-18T00:01:50.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20952025-07-18T00:01:50.475ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
20962025-07-18T00:01:50.475ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
20972025-07-18T00:01:50.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
20982025-07-18T00:01:50.476ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20992025-07-18T00:01:50.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21002025-07-18T00:01:50.483ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
21012025-07-18T00:01:50.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
21022025-07-18T00:01:50.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21032025-07-18T00:01:50.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
21042025-07-18T00:01:50.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
21052025-07-18T00:01:50.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
21062025-07-18T00:01:50.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21072025-07-18T00:01:50.497ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
21082025-07-18T00:01:50.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
21092025-07-18T00:01:50.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
21102025-07-18T00:01:50.499ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
21112025-07-18T00:01:50.499ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21122025-07-18T00:01:50.500ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1aa1cd4-8169-4c3a-a3bc-628cff314ebb", "content-length": "26", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
21132025-07-18T00:01:50.500ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21142025-07-18T00:01:50.503ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
21152025-07-18T00:01:50.503ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 287.873202ms iteration = 5 status = {"blueprint_id":"9092da00-a622-42cf-99af-453ea64d4a35","inventory_collection_id":"78d39801-5737-4991-a5a6-1abe7d8457d5","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
21162025-07-18T00:01:50.506ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21172025-07-18T00:01:50.512ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21182025-07-18T00:01:50.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21192025-07-18T00:01:50.515ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21202025-07-18T00:01:50.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21212025-07-18T00:01:50.518ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21222025-07-18T00:01:50.520ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-17T23:51:46.880014Z, time_modified: 2025-07-17T23:51:46.880014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f37123ec-61ff-4793-867b-6920b7f6246a, db_silo: Silo { identity: SiloIdentity { id: f37123ec-61ff-4793-867b-6920b7f6246a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-17T23:52:11.102986Z, time_modified: 2025-07-17T23:52:11.102986Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f37123ec-61ff-4793-867b-6920b7f6246a, db_silo: Silo { identity: SiloIdentity { id: f37123ec-61ff-4793-867b-6920b7f6246a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-17T23:52:11.102986Z, time_modified: 2025-07-17T23:52:11.102986Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3" }] }) }
21232025-07-18T00:01:50.520ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 312.548282ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f37123ec-61ff-4793-867b-6920b7f6246a","tls_certs":["6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3"]}},"default_endpoint":{"silo_id":"f37123ec-61ff-4793-867b-6920b7f6246a","tls_certs":["6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
21242025-07-18T00:01:50.525ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 434504ca-585c-4496-b93b-17ff4433d516 file = nexus/db-queries/src/db/datastore/inventory.rs:2039 nboot_partitions = 0 ncabooses = 0 nclickhouse_keeper_membership = 0 ncockroach_status = 0 ncollections = 0 nconfig_reconcilers = 0 ndatasets = 0 nerrors = 0 nlast_reconciliation_dataset_results = 0 nlast_reconciliation_disk_results = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 0 nmupdate_override_non_boot = 0 nnvme_disk_firmware = 0 nomicron_sled_config_datasets = 0 nomicron_sled_config_disks = 0 nomicron_sled_config_zone_nics = 0 nomicron_sled_config_zones = 0 nomicron_sled_configs = 0 nphysical_disks = 0 nrot_pages = 0 nrots = 0 nsled_agents = 0 nsps = 0 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 0
21252025-07-18T00:01:50.525ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
21262025-07-18T00:01:50.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
21272025-07-18T00:01:50.527ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 zone_address = fd00:1122:3344:101::2
21282025-07-18T00:01:50.527ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21292025-07-18T00:01:50.527ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e0d0851-c2b1-45bb-8acc-79f422f4e69a", "content-length": "26", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
21302025-07-18T00:01:50.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
21312025-07-18T00:01:50.527ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21322025-07-18T00:01:50.527ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21332025-07-18T00:01:50.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21342025-07-18T00:01:50.529ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
21352025-07-18T00:01:50.530ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(9d5274a9-bbd9-4af0-aa29-90cf0978f221, 0), (65847ff3-68d8-4df2-a4d6-fdb0f14fc4a1, 0), (78d39801-5737-4991-a5a6-1abe7d8457d5, 0)]
21362025-07-18T00:01:50.531ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21372025-07-18T00:01:50.531ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 609470778 } })
21382025-07-18T00:01:50.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21392025-07-18T00:01:50.534ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21402025-07-18T00:01:50.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21412025-07-18T00:01:50.535ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
21422025-07-18T00:01:50.535ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 319.763693ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
21432025-07-18T00:01:50.537ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21442025-07-18T00:01:50.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21452025-07-18T00:01:50.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21462025-07-18T00:01:50.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21472025-07-18T00:01:50.542ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21482025-07-18T00:01:50.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21492025-07-18T00:01:50.545ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21502025-07-18T00:01:50.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21512025-07-18T00:01:50.547ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21522025-07-18T00:01:50.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
21532025-07-18T00:01:50.552ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21542025-07-18T00:01:50.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21552025-07-18T00:01:50.558ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
21562025-07-18T00:01:50.560ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21572025-07-18T00:01:50.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21582025-07-18T00:01:50.563ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21592025-07-18T00:01:50.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21602025-07-18T00:01:50.566ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21612025-07-18T00:01:50.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21622025-07-18T00:01:50.569ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21632025-07-18T00:01:50.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21642025-07-18T00:01:50.572ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21652025-07-18T00:01:50.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21662025-07-18T00:01:50.574ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21672025-07-18T00:01:50.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21682025-07-18T00:01:50.575ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21692025-07-18T00:01:50.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
21702025-07-18T00:01:50.581ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21712025-07-18T00:01:50.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21722025-07-18T00:01:50.583ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21732025-07-18T00:01:50.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21742025-07-18T00:01:50.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21752025-07-18T00:01:50.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21762025-07-18T00:01:50.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21772025-07-18T00:01:50.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
21782025-07-18T00:01:50.592ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21792025-07-18T00:01:50.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21802025-07-18T00:01:50.597ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21812025-07-18T00:01:50.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21822025-07-18T00:01:50.599ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21832025-07-18T00:01:50.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21842025-07-18T00:01:50.601ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21852025-07-18T00:01:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21862025-07-18T00:01:50.603ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
21872025-07-18T00:01:50.603ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9ffac66-65b8-4e7b-a6ed-28a86e1c260a", "content-length": "78", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
21882025-07-18T00:01:50.603ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
21892025-07-18T00:01:50.603ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
21902025-07-18T00:01:50.603ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
21912025-07-18T00:01:50.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
21922025-07-18T00:01:50.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
21932025-07-18T00:01:50.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
21942025-07-18T00:01:50.605ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21952025-07-18T00:01:50.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21962025-07-18T00:01:50.605ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
21972025-07-18T00:01:50.606ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
21982025-07-18T00:01:50.606ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
21992025-07-18T00:01:50.608ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
22002025-07-18T00:01:50.608ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22012025-07-18T00:01:50.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22022025-07-18T00:01:50.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
22032025-07-18T00:01:50.609ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
22042025-07-18T00:01:50.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
22052025-07-18T00:01:50.610ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22062025-07-18T00:01:50.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
22072025-07-18T00:01:50.610ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
22082025-07-18T00:01:50.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
22092025-07-18T00:01:50.610ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
22102025-07-18T00:01:50.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
22112025-07-18T00:01:50.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
22122025-07-18T00:01:50.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22132025-07-18T00:01:50.611ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
22142025-07-18T00:01:50.611ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
22152025-07-18T00:01:50.612ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "596fde27-5e8b-4f64-827c-2a9fa008c974", "content-length": "81", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22162025-07-18T00:01:50.612ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22172025-07-18T00:01:50.612ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
22182025-07-18T00:01:50.612ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
22192025-07-18T00:01:50.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22202025-07-18T00:01:50.612ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "e928b2cc-6737-42a4-96aa-b0eafd08ab38", "content-length": "81", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22212025-07-18T00:01:50.614ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22222025-07-18T00:01:50.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
22232025-07-18T00:01:50.619ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22242025-07-18T00:01:50.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22252025-07-18T00:01:50.621ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22262025-07-18T00:01:50.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22272025-07-18T00:01:50.622ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22282025-07-18T00:01:50.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22292025-07-18T00:01:50.624ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22302025-07-18T00:01:50.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ed9681b3-56ed-46b4-8167-67a116e1f8bd roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
22312025-07-18T00:01:50.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ed9681b3-56ed-46b4-8167-67a116e1f8bd resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
22322025-07-18T00:01:50.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ed9681b3-56ed-46b4-8167-67a116e1f8bd response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
22332025-07-18T00:01:50.629ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
22342025-07-18T00:01:50.629ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22352025-07-18T00:01:50.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22362025-07-18T00:01:50.637ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 2edd1f86-eacb-4f90-994b-9e3d000cad55, kind: Service { id: da3261f0-45ba-4fbf-b6bb-a5a70850db80 }, name: Name("external-dns-da3261f0-45ba-4fbf-b6bb-a5a70850db80"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 167])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: caffcd22-d18a-4c83-b529-33331ab1f212, kind: Service { id: 464a3447-fe1f-417e-b585-925f5fb5bfdc }, name: Name("external-dns-464a3447-fe1f-417e-b585-925f5fb5bfdc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 152])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 23543894-5a60-41c8-baaa-d064e693cc44, kind: Service { id: 690698cb-6dda-4097-94ef-79e231d067b0 }, name: Name("nexus-690698cb-6dda-4097-94ef-79e231d067b0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 245])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9272f456-755c-43da-8552-57bcf4e281cc, kind: Service { id: 79e7c92c-8e83-4180-bbfe-92325edee698 }, name: Name("nexus-79e7c92c-8e83-4180-bbfe-92325edee698"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 64])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c5703fb7-5378-4f4f-a496-662fbb116f6e, kind: Service { id: c6315a73-acf3-4126-98d0-c1b30f1ae116 }, name: Name("nexus-c6315a73-acf3-4126-98d0-c1b30f1ae116"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 208])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
22372025-07-18T00:01:50.637ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22382025-07-18T00:01:50.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22392025-07-18T00:01:50.661ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
22402025-07-18T00:01:50.661ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
22412025-07-18T00:01:50.662ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c36a095-ea6c-425a-99a7-142408cbb251", "content-length": "81", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22422025-07-18T00:01:50.664ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 443.772672ms iteration = 21 status = {"errors":[],"sps":[]}
22432025-07-18T00:01:50.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22442025-07-18T00:01:50.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22452025-07-18T00:01:50.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22462025-07-18T00:01:50.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22472025-07-18T00:01:50.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22482025-07-18T00:01:50.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22492025-07-18T00:01:50.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22502025-07-18T00:01:50.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22512025-07-18T00:01:50.674ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22522025-07-18T00:01:50.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22532025-07-18T00:01:50.690ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22542025-07-18T00:01:50.692ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
22552025-07-18T00:01:50.692ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22562025-07-18T00:01:50.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22572025-07-18T00:01:50.695ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
22582025-07-18T00:01:50.695ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2edd1f86-eacb-4f90-994b-9e3d000cad55, kind: Service { id: da3261f0-45ba-4fbf-b6bb-a5a70850db80 }, name: Name("external-dns-da3261f0-45ba-4fbf-b6bb-a5a70850db80"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 167])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: caffcd22-d18a-4c83-b529-33331ab1f212, kind: Service { id: 464a3447-fe1f-417e-b585-925f5fb5bfdc }, name: Name("external-dns-464a3447-fe1f-417e-b585-925f5fb5bfdc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 152])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 23543894-5a60-41c8-baaa-d064e693cc44, kind: Service { id: 690698cb-6dda-4097-94ef-79e231d067b0 }, name: Name("nexus-690698cb-6dda-4097-94ef-79e231d067b0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 245])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9272f456-755c-43da-8552-57bcf4e281cc, kind: Service { id: 79e7c92c-8e83-4180-bbfe-92325edee698 }, name: Name("nexus-79e7c92c-8e83-4180-bbfe-92325edee698"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 64])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c5703fb7-5378-4f4f-a496-662fbb116f6e, kind: Service { id: c6315a73-acf3-4126-98d0-c1b30f1ae116 }, name: Name("nexus-c6315a73-acf3-4126-98d0-c1b30f1ae116"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 208])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2edd1f86-eacb-4f90-994b-9e3d000cad55, kind: Service { id: da3261f0-45ba-4fbf-b6bb-a5a70850db80 }, name: Name("external-dns-da3261f0-45ba-4fbf-b6bb-a5a70850db80"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 167])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: caffcd22-d18a-4c83-b529-33331ab1f212, kind: Service { id: 464a3447-fe1f-417e-b585-925f5fb5bfdc }, name: Name("external-dns-464a3447-fe1f-417e-b585-925f5fb5bfdc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 152])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 23543894-5a60-41c8-baaa-d064e693cc44, kind: Service { id: 690698cb-6dda-4097-94ef-79e231d067b0 }, name: Name("nexus-690698cb-6dda-4097-94ef-79e231d067b0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 245])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9272f456-755c-43da-8552-57bcf4e281cc, kind: Service { id: 79e7c92c-8e83-4180-bbfe-92325edee698 }, name: Name("nexus-79e7c92c-8e83-4180-bbfe-92325edee698"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 64])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c5703fb7-5378-4f4f-a496-662fbb116f6e, kind: Service { id: c6315a73-acf3-4126-98d0-c1b30f1ae116 }, name: Name("nexus-c6315a73-acf3-4126-98d0-c1b30f1ae116"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 208])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
22592025-07-18T00:01:50.695ZDEBGnexus (service-firewall-rule-progator): resolved 3 rules for sleds background_task = service_firewall_rule_propagation
22602025-07-18T00:01:50.774ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
22612025-07-18T00:01:50.774ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22622025-07-18T00:01:50.775ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "14fb13b7-ff0a-4d85-b1a2-5f668fbaa5cf", "content-length": "26", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22632025-07-18T00:01:50.775ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22642025-07-18T00:01:50.777ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22652025-07-18T00:01:50.781ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22662025-07-18T00:01:50.781ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22672025-07-18T00:01:50.781ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a204cfcd-acf3-47c1-9451-68a8652df5e4", "content-length": "372", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22682025-07-18T00:01:50.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22692025-07-18T00:01:50.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22702025-07-18T00:01:50.787ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
22712025-07-18T00:01:50.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
22722025-07-18T00:01:50.789ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("2e50d34b-ee4f-421d-bed3-188c8630008c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("58a2a5e4-3670-4be2-baae-fa232facdb16.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("7ea31120-232a-481d-a92b-a33f3e43b188.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("8a6adeaa-eb40-46ae-8be0-0f15632f7f5e.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("8d353dcd-6104-4d89-a804-9602839d9a0f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8d353dcd-6104-4d89-a804-9602839d9a0f.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::4)) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 867564471 } })
22732025-07-18T00:01:50.790ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22742025-07-18T00:01:50.790ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
22752025-07-18T00:01:50.790ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
22762025-07-18T00:01:50.790ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
22772025-07-18T00:01:50.791ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "912e057b-c0b4-4c8d-8bbd-54f2ac760989", "content-length": "476", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22782025-07-18T00:01:50.791ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
22792025-07-18T00:01:50.791ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4c73413-400d-4c26-9721-e66ffa836271", "content-length": "734", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22802025-07-18T00:01:50.791ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
22812025-07-18T00:01:50.791ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e39788d-e207-46c3-a1ef-58ff0956b90e", "content-length": "111", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22822025-07-18T00:01:50.791ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
22832025-07-18T00:01:50.792ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4222424d-acb2-4f31-8177-4fa92a61da0e", "content-length": "111", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22842025-07-18T00:01:50.792ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
22852025-07-18T00:01:50.792ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "159a8ac8-eebb-4453-911d-17ceda3f0014", "content-length": "170", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22862025-07-18T00:01:50.792ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
22872025-07-18T00:01:50.793ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7d6c48c-da0d-4693-b9b5-f595994e1f23", "content-length": "170", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22882025-07-18T00:01:50.793ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
22892025-07-18T00:01:50.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
22902025-07-18T00:01:50.793ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
22912025-07-18T00:01:50.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
22922025-07-18T00:01:50.793ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "45d4731b-0438-450d-ada6-c5e2ad5c4073", "content-length": "179", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22932025-07-18T00:01:50.794ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
22942025-07-18T00:01:50.794ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "11d34a6d-0300-4871-85c5-453b90798abc", "content-length": "179", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22952025-07-18T00:01:50.794ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
22962025-07-18T00:01:50.794ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fd439e2-5aeb-47e9-934f-e2e813cd055e", "content-length": "702", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22972025-07-18T00:01:50.794ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
22982025-07-18T00:01:50.795ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcfc7e54-4483-444a-b0e0-5d6f7cf52802", "content-length": "727", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
22992025-07-18T00:01:50.795ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
23002025-07-18T00:01:50.795ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "03c5d776-9607-4bc2-863d-6e0493e422ad", "content-length": "729", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23012025-07-18T00:01:50.795ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
23022025-07-18T00:01:50.795ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
23032025-07-18T00:01:50.795ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d98028e9-b4fc-45c5-b56d-869976efc49f", "content-length": "728", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23042025-07-18T00:01:50.795ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
23052025-07-18T00:01:50.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
23062025-07-18T00:01:50.796ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5d190e0-494c-4566-97e8-a3508ec9b03c", "content-length": "722", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23072025-07-18T00:01:50.796ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
23082025-07-18T00:01:50.796ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1e8e8e8-8dd4-44b5-90ef-02d1bf18e0df", "content-length": "109", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23092025-07-18T00:01:50.796ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
23102025-07-18T00:01:50.796ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "084b55c9-8212-4b28-b2ec-dc388e242cf3", "content-length": "109", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23112025-07-18T00:01:50.796ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
23122025-07-18T00:01:50.797ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d61eafb-5119-49cd-964e-5e9c4c69a1fc", "content-length": "169", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23132025-07-18T00:01:50.797ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
23142025-07-18T00:01:50.797ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "db9a802c-f8ef-4da2-9a0e-65fb5d27cc49", "content-length": "169", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23152025-07-18T00:01:50.797ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
23162025-07-18T00:01:50.797ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "af3eeb47-ffd7-429f-addf-8986db2ac7db", "content-length": "178", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23172025-07-18T00:01:50.797ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
23182025-07-18T00:01:50.798ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23192025-07-18T00:01:50.798ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "572d938b-e7ff-490e-acc1-a8e44ca59453", "content-length": "178", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23202025-07-18T00:01:50.798ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
23212025-07-18T00:01:50.798ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "17ca156e-7c0c-43c7-a7e6-41ca34a5274d", "content-length": "702", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23222025-07-18T00:01:50.798ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
23232025-07-18T00:01:50.798ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b266994e-8ad2-450a-8f30-f1ad45a0cf27", "content-length": "727", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23242025-07-18T00:01:50.798ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
23252025-07-18T00:01:50.798ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "068d4789-1fb1-4e1c-ab99-8e3205cbe56a", "content-length": "729", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23262025-07-18T00:01:50.798ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
23272025-07-18T00:01:50.799ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bc05144-1b4b-4679-9aad-29fc06d542ed", "content-length": "728", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23282025-07-18T00:01:50.799ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23292025-07-18T00:01:50.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23302025-07-18T00:01:50.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
23312025-07-18T00:01:50.800ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
23322025-07-18T00:01:50.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
23332025-07-18T00:01:50.800ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23342025-07-18T00:01:50.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
23352025-07-18T00:01:50.802ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23362025-07-18T00:01:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23372025-07-18T00:01:50.803ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
23382025-07-18T00:01:50.803ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "c9fa996d-13df-4ab6-86fb-173cfbb937d9", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23392025-07-18T00:01:50.803ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
23402025-07-18T00:01:50.803ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8070b2b-6b13-4a33-b42d-8ebd73fe1265", "content-length": "26", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23412025-07-18T00:01:50.803ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:672 sled = http://[fd00:1122:3344:101::1]:12345
23422025-07-18T00:01:50.804ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23432025-07-18T00:01:50.805ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 585.366102ms iteration = 3 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":2,"put_config_err":0,"put_config_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"4a597d98-bd6a-42be-a09e-71b1fbba6de5","time":"2025-07-17T23:56:50.864459300Z"},{"operation":"list","target_sled":"4a597d98-bd6a-42be-a09e-71b1fbba6de5","time":"2025-07-17T23:56:50.870537404Z"},{"generation":1,"operation":"put_config","target_sled":"4a597d98-bd6a-42be-a09e-71b1fbba6de5","time":"2025-07-18T00:01:50.803790574Z"},{"operation":"list","target_sled":"4a597d98-bd6a-42be-a09e-71b1fbba6de5","time":"2025-07-18T00:01:50.803977537Z"}]}
23442025-07-18T00:01:50.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
23452025-07-18T00:01:50.807ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23462025-07-18T00:01:50.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23472025-07-18T00:01:50.808ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
23482025-07-18T00:01:50.808ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "67acd1be-08b0-4274-9c58-c277f8acbc63", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23492025-07-18T00:01:50.808ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23502025-07-18T00:01:50.810ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "67a54ca4-632c-4232-849b-727e4dd89352", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23512025-07-18T00:01:50.810ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23522025-07-18T00:01:50.812ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23532025-07-18T00:01:50.812ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 604.284673ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
23542025-07-18T00:01:50.839ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23552025-07-18T00:01:50.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23562025-07-18T00:01:50.841ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 633.675735ms iteration = 21 status = null
23572025-07-18T00:01:50.844ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
23582025-07-18T00:01:50.844ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
23592025-07-18T00:01:50.844ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fe2cb2fa-6f72-4648-8097-32fed59c2946", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23602025-07-18T00:01:50.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23612025-07-18T00:01:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23622025-07-18T00:01:50.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23632025-07-18T00:01:50.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23642025-07-18T00:01:50.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23652025-07-18T00:01:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23662025-07-18T00:01:50.854ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
23672025-07-18T00:01:50.854ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23682025-07-18T00:01:50.854ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1cc9eefb-b859-4a4c-85ba-f07bc2085508", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23692025-07-18T00:01:50.856ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, time_created: 2025-07-17T23:52:07.866488Z, time_modified: 2025-07-17T23:52:07.866488Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e4e73d6b-d53c-414c-93a8-eff1ed3c4807, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
23702025-07-18T00:01:50.856ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
23712025-07-18T00:01:50.857ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 641.443745ms iteration = 21 status = {}
23722025-07-18T00:01:50.870ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
23732025-07-18T00:01:50.930ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23742025-07-18T00:01:50.933ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "38f86225-9d43-435c-bbb6-108b1660b9be", "content-length": "691", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
23752025-07-18T00:01:50.933ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
23762025-07-18T00:01:50.933ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
23772025-07-18T00:01:50.933ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
23782025-07-18T00:01:50.936ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 727.985638ms iteration = 21 status = {}
23792025-07-18T00:01:50.936ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 720.792046ms iteration = 21 status = {}
23802025-07-18T00:01:50.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 63651bdc-a132-4855-a2d9-e5783bb00a85 roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
23812025-07-18T00:01:50.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 63651bdc-a132-4855-a2d9-e5783bb00a85 resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
23822025-07-18T00:01:50.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 63651bdc-a132-4855-a2d9-e5783bb00a85 response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
23832025-07-18T00:01:50.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 133d1acb-0101-4f9d-b0f5-da83e58cf301 roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
23842025-07-18T00:01:50.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 133d1acb-0101-4f9d-b0f5-da83e58cf301 resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
23852025-07-18T00:01:50.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58709 req_id = 133d1acb-0101-4f9d-b0f5-da83e58cf301 response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
23862025-07-18T00:01:50.978ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 661 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 2c29b828-20d0-4bce-94b0-4cf780d8316a response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
23872025-07-18T00:01:51.016ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
23882025-07-18T00:01:51.017ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "183fc80a-706f-43c7-a847-e1cfcbdaddf7", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
23892025-07-18T00:01:51.017ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
23902025-07-18T00:01:51.019ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "271a81d1-a59e-4c0c-92ca-b6f358ab142b", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
23912025-07-18T00:01:51.019ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
23922025-07-18T00:01:51.021ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e0bd7a4b-501a-4997-a031-d47ff81fe87c", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
23932025-07-18T00:01:51.021ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
23942025-07-18T00:01:51.023ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
23952025-07-18T00:01:51.024ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 815.909581ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
23962025-07-18T00:01:51.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23972025-07-18T00:01:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23982025-07-18T00:01:51.066ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a2d734dc-e0c9-4fd6-b442-f2c4e63791e5, rack_id: e4e73d6b-d53c-414c-93a8-eff1ed3c4807, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(9d790dba-5335-4b4c-be2a-58416dc1e8f5) } rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
23992025-07-18T00:01:51.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24002025-07-18T00:01:51.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24012025-07-18T00:01:51.072ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24022025-07-18T00:01:51.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24032025-07-18T00:01:51.074ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24042025-07-18T00:01:51.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24052025-07-18T00:01:51.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24062025-07-18T00:01:51.078ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
24072025-07-18T00:01:51.078ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
24082025-07-18T00:01:51.079ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
24092025-07-18T00:01:51.079ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 9d790dba-5335-4b4c-be2a-58416dc1e8f5
24102025-07-18T00:01:51.079ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24112025-07-18T00:01:51.079ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24122025-07-18T00:01:51.079ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24132025-07-18T00:01:51.079ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24142025-07-18T00:01:51.079ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24152025-07-18T00:01:51.079ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24162025-07-18T00:01:51.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, lookup_type: ById(4a597d98-bd6a-42be-a09e-71b1fbba6de5) } result = Ok(())
24172025-07-18T00:01:51.079ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24182025-07-18T00:01:51.079ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24192025-07-18T00:01:51.079ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24202025-07-18T00:01:51.080ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
24212025-07-18T00:01:51.080ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24222025-07-18T00:01:51.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24232025-07-18T00:01:51.084ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
24242025-07-18T00:01:51.084ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24252025-07-18T00:01:51.094ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "da9f0f9c-cee3-426a-90b2-2a1901730289", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
24262025-07-18T00:01:51.096ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:491
24272025-07-18T00:01:51.096ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 880.988063ms
24282025-07-18T00:01:51.096ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 880.999064ms iteration = 3 status = {}
24292025-07-18T00:01:51.131ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f13c7c2-1f73-4f5c-afa6-36f9295981e3", "content-length": "88894", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
24302025-07-18T00:01:51.134ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
24312025-07-18T00:01:51.134ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
24322025-07-18T00:01:51.134ZDEBGnexus (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
24332025-07-18T00:01:51.134ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
24342025-07-18T00:01:51.134ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
24352025-07-18T00:01:51.134ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
24362025-07-18T00:01:51.134ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
24372025-07-18T00:01:51.134ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
24382025-07-18T00:01:51.134ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c85b9c3-b40d-4fd3-9136-c412418d1ca6", "content-length": "64", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
24392025-07-18T00:01:51.134ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/proxy/status/vars
24402025-07-18T00:01:51.134ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dd75421-0599-411c-966e-5fbfb03c948c", "content-length": "64", "date": "Fri, 18 Jul 2025 00:01:51 GMT"} })
24412025-07-18T00:01:51.134ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d41f97c-b394-4600-af8a-a360806121f5", "content-length": "64", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
24422025-07-18T00:01:51.134ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/proxy/status/vars
24432025-07-18T00:01:51.134ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4666230-9b22-421d-95d4-aeedc5deb253", "content-length": "64", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
24442025-07-18T00:01:51.134ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/proxy/status/vars
24452025-07-18T00:01:51.135ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/proxy/status/vars
24462025-07-18T00:01:51.135ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "412164cd-37d7-4378-a8ed-9ecb51f8b534", "content-length": "64", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
24472025-07-18T00:01:51.135ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/proxy/status/vars
24482025-07-18T00:01:51.176ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "454f11f5-202e-49a4-8b57-6fc72bbca9c7", "content-length": "424183", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
24492025-07-18T00:01:51.176ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "db762f37-2407-40ee-9e17-ecae8aa79765", "content-length": "390849", "date": "Fri, 18 Jul 2025 00:01:51 GMT"} })
24502025-07-18T00:01:51.179ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1fe1259-eb23-4b3f-8c82-ea12547e3327", "content-length": "400563", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
24512025-07-18T00:01:51.180ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "f89184c6-03fb-4b8d-a865-f71436a54dad", "content-length": "391899", "date": "Fri, 18 Jul 2025 00:01:51 GMT"} })
24522025-07-18T00:01:51.187ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2952b75-32d3-479e-8fa6-7e3c474cad04", "content-length": "389592", "date": "Fri, 18 Jul 2025 00:01:51 GMT"} })
24532025-07-18T00:01:51.190ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 1
24542025-07-18T00:01:51.190ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 2
24552025-07-18T00:01:51.190ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 3
24562025-07-18T00:01:51.190ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 4
24572025-07-18T00:01:51.190ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 5
24582025-07-18T00:01:51.190ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
24592025-07-18T00:01:51.192ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
24602025-07-18T00:01:51.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
24612025-07-18T00:01:51.194ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24622025-07-18T00:01:51.196ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
24632025-07-18T00:01:51.196ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
24642025-07-18T00:01:51.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
24652025-07-18T00:01:51.267ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2b651ef2-4283-430e-bf6a-c46c13ab9970", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
24662025-07-18T00:01:51.267ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch = Switch0
24672025-07-18T00:01:51.267ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24682025-07-18T00:01:51.273ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "96b2eb0e-745d-490a-b02a-544d7abd79e0", "content-length": "682", "date": "Fri, 18 Jul 2025 00:01:50 GMT"} })
24692025-07-18T00:01:51.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24702025-07-18T00:01:51.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24712025-07-18T00:01:51.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24722025-07-18T00:01:51.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24732025-07-18T00:01:51.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24742025-07-18T00:01:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24752025-07-18T00:01:51.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24762025-07-18T00:01:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24772025-07-18T00:01:51.292ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.07638134s iteration = 21 status = {}
24782025-07-18T00:01:51.403ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 727da6a1-5558-44c7-a186-a0025301e856 file = nexus/db-queries/src/db/datastore/inventory.rs:1442
24792025-07-18T00:01:51.403ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 727da6a1-5558-44c7-a186-a0025301e856 time_started = 2025-07-18 00:01:50.790708 UTC
24802025-07-18T00:01:51.403ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
24812025-07-18T00:01:51.403ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 15 reason = Dependency
24822025-07-18T00:01:51.403ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
24832025-07-18T00:01:51.403ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
24842025-07-18T00:01:51.403ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 10.6\u{b5}s iteration = 15 status = "Disabled"
24852025-07-18T00:01:51.403ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24862025-07-18T00:01:51.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
24872025-07-18T00:01:51.403ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.193359622s iteration = 3 status = {"collection_id":"727da6a1-5558-44c7-a186-a0025301e856","time_done":"2025-07-18 00:01:51.190820 UTC","time_started":"2025-07-18 00:01:50.790708 UTC"}
24882025-07-18T00:01:51.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24892025-07-18T00:01:51.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24902025-07-18T00:01:51.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24912025-07-18T00:01:51.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24922025-07-18T00:01:51.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24932025-07-18T00:01:51.408ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24942025-07-18T00:01:51.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24952025-07-18T00:01:51.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
24962025-07-18T00:01:51.409ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
24972025-07-18T00:01:51.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
24982025-07-18T00:01:51.410ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24992025-07-18T00:01:51.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25002025-07-18T00:01:51.412ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25012025-07-18T00:01:51.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25022025-07-18T00:01:51.414ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25032025-07-18T00:01:51.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25042025-07-18T00:01:51.500ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 96.982243ms iteration = 24 status = {"physical_disks_added":0}
25052025-07-18T00:01:51.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25062025-07-18T00:01:51.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25072025-07-18T00:01:51.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25082025-07-18T00:01:51.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25092025-07-18T00:01:51.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25102025-07-18T00:01:51.636ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
25112025-07-18T00:01:51.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25122025-07-18T00:01:51.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25132025-07-18T00:01:51.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25142025-07-18T00:01:51.640ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
25152025-07-18T00:01:51.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25162025-07-18T00:01:51.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25172025-07-18T00:01:51.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25182025-07-18T00:01:51.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25192025-07-18T00:01:51.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25202025-07-18T00:01:51.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4e1b566a-3559-4318-a5c4-033b50874de2 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25212025-07-18T00:01:51.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4e1b566a-3559-4318-a5c4-033b50874de2 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25222025-07-18T00:01:51.645ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
25232025-07-18T00:01:51.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25242025-07-18T00:01:51.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25252025-07-18T00:01:51.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4e1b566a-3559-4318-a5c4-033b50874de2 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25262025-07-18T00:01:51.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25272025-07-18T00:01:51.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
25282025-07-18T00:01:51.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
25292025-07-18T00:01:51.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
25302025-07-18T00:01:51.652ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
25312025-07-18T00:01:51.652ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 248.705489ms iteration = 6 status = {"blueprint_id":"9092da00-a622-42cf-99af-453ea64d4a35","inventory_collection_id":"64643830-43b5-4871-a3e9-f0c1181c1034","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
25322025-07-18T00:01:52.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8b363269-88ed-446d-90dd-6011c33e9093 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25332025-07-18T00:01:52.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8b363269-88ed-446d-90dd-6011c33e9093 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25342025-07-18T00:01:52.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8b363269-88ed-446d-90dd-6011c33e9093 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25352025-07-18T00:01:53.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 151683c2-1cda-4bb0-a1db-8bc889843b95 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25362025-07-18T00:01:53.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 151683c2-1cda-4bb0-a1db-8bc889843b95 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25372025-07-18T00:01:53.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 151683c2-1cda-4bb0-a1db-8bc889843b95 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25382025-07-18T00:01:54.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 04228b9b-e5b2-4f20-8991-5741e6823a13 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25392025-07-18T00:01:54.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 04228b9b-e5b2-4f20-8991-5741e6823a13 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25402025-07-18T00:01:54.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 04228b9b-e5b2-4f20-8991-5741e6823a13 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25412025-07-18T00:01:55.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 122 reason = Timeout
25422025-07-18T00:01:55.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
25432025-07-18T00:01:55.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
25442025-07-18T00:01:55.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25452025-07-18T00:01:55.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
25462025-07-18T00:01:55.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
25472025-07-18T00:01:55.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
25482025-07-18T00:01:55.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
25492025-07-18T00:01:55.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.51397ms iteration = 122 status = {"chicken_switches_updated":false}
25502025-07-18T00:01:55.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 712211ca-36bc-4b58-9766-7ddb0d7d2e74 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25512025-07-18T00:01:55.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 712211ca-36bc-4b58-9766-7ddb0d7d2e74 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25522025-07-18T00:01:55.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 712211ca-36bc-4b58-9766-7ddb0d7d2e74 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25532025-07-18T00:01:56.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8223f9f0-9d09-4022-8190-0a184de7d0f1 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25542025-07-18T00:01:56.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8223f9f0-9d09-4022-8190-0a184de7d0f1 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25552025-07-18T00:01:56.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8223f9f0-9d09-4022-8190-0a184de7d0f1 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25562025-07-18T00:01:57.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5a393755-7bad-4a21-8301-a8c0b76e0b6e roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25572025-07-18T00:01:57.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5a393755-7bad-4a21-8301-a8c0b76e0b6e resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25582025-07-18T00:01:57.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5a393755-7bad-4a21-8301-a8c0b76e0b6e response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25592025-07-18T00:01:58.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 96e0a563-7826-42a4-bcf2-1cdb7ad8e86c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25602025-07-18T00:01:58.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 96e0a563-7826-42a4-bcf2-1cdb7ad8e86c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25612025-07-18T00:01:58.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 96e0a563-7826-42a4-bcf2-1cdb7ad8e86c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25622025-07-18T00:01:59.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48ffb142-e5d8-4312-b514-c916d76d1833 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25632025-07-18T00:01:59.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48ffb142-e5d8-4312-b514-c916d76d1833 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25642025-07-18T00:01:59.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48ffb142-e5d8-4312-b514-c916d76d1833 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25652025-07-18T00:02:00.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 123 reason = Timeout
25662025-07-18T00:02:00.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
25672025-07-18T00:02:00.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
25682025-07-18T00:02:00.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25692025-07-18T00:02:00.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
25702025-07-18T00:02:00.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
25712025-07-18T00:02:00.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
25722025-07-18T00:02:00.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
25732025-07-18T00:02:00.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25742025-07-18T00:02:00.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
25752025-07-18T00:02:00.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25762025-07-18T00:02:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25772025-07-18T00:02:00.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
25782025-07-18T00:02:00.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.311017ms iteration = 123 status = {"chicken_switches_updated":false}
25792025-07-18T00:02:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25802025-07-18T00:02:00.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25812025-07-18T00:02:00.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25822025-07-18T00:02:00.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25832025-07-18T00:02:00.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25842025-07-18T00:02:00.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25852025-07-18T00:02:00.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25862025-07-18T00:02:00.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25872025-07-18T00:02:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
25882025-07-18T00:02:00.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25892025-07-18T00:02:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25902025-07-18T00:02:00.240ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
25912025-07-18T00:02:00.240ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.00546ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
25922025-07-18T00:02:00.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25932025-07-18T00:02:00.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25942025-07-18T00:02:00.284ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.566216ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25952025-07-18T00:02:00.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 58880c1a-99db-4dad-95f1-cff87e9d43e7 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25962025-07-18T00:02:00.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 58880c1a-99db-4dad-95f1-cff87e9d43e7 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25972025-07-18T00:02:00.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 58880c1a-99db-4dad-95f1-cff87e9d43e7 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
25982025-07-18T00:02:00.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 622 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = df8f91ba-36f8-4d15-957e-925f911a96a1 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
25992025-07-18T00:02:01.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2a8cca12-e745-4309-bd7e-d7c5d1301781 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26002025-07-18T00:02:01.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2a8cca12-e745-4309-bd7e-d7c5d1301781 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26012025-07-18T00:02:01.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2a8cca12-e745-4309-bd7e-d7c5d1301781 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26022025-07-18T00:02:02.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 54e17b3a-080d-4b85-8cc6-abadde1836c5 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26032025-07-18T00:02:02.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 54e17b3a-080d-4b85-8cc6-abadde1836c5 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26042025-07-18T00:02:02.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 54e17b3a-080d-4b85-8cc6-abadde1836c5 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26052025-07-18T00:02:03.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9584d9ff-7717-4d50-83bd-2fdcffff83ba roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26062025-07-18T00:02:03.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9584d9ff-7717-4d50-83bd-2fdcffff83ba resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26072025-07-18T00:02:03.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1732 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9584d9ff-7717-4d50-83bd-2fdcffff83ba response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26082025-07-18T00:02:04.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6b08b747-83ee-43f7-9b19-11b8b40f93d5 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26092025-07-18T00:02:04.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6b08b747-83ee-43f7-9b19-11b8b40f93d5 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26102025-07-18T00:02:04.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6b08b747-83ee-43f7-9b19-11b8b40f93d5 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26112025-07-18T00:02:05.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 124 reason = Timeout
26122025-07-18T00:02:05.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
26132025-07-18T00:02:05.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
26142025-07-18T00:02:05.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26152025-07-18T00:02:05.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
26162025-07-18T00:02:05.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
26172025-07-18T00:02:05.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
26182025-07-18T00:02:05.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
26192025-07-18T00:02:05.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.300537ms iteration = 124 status = {"chicken_switches_updated":false}
26202025-07-18T00:02:05.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b59f0c5d-7d58-4e21-84d5-c23671ea6455 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26212025-07-18T00:02:05.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b59f0c5d-7d58-4e21-84d5-c23671ea6455 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26222025-07-18T00:02:05.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b59f0c5d-7d58-4e21-84d5-c23671ea6455 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26232025-07-18T00:02:06.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2d8c84ad-db38-4899-bf27-2a85035280b4 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26242025-07-18T00:02:06.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2d8c84ad-db38-4899-bf27-2a85035280b4 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26252025-07-18T00:02:06.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2d8c84ad-db38-4899-bf27-2a85035280b4 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26262025-07-18T00:02:07.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 68ea446a-7819-4506-b037-2646ea932d79 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26272025-07-18T00:02:07.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 68ea446a-7819-4506-b037-2646ea932d79 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26282025-07-18T00:02:07.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 68ea446a-7819-4506-b037-2646ea932d79 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26292025-07-18T00:02:08.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0ec7f91e-80a0-40b9-b0b4-c043ac8307d9 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26302025-07-18T00:02:08.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0ec7f91e-80a0-40b9-b0b4-c043ac8307d9 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26312025-07-18T00:02:08.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0ec7f91e-80a0-40b9-b0b4-c043ac8307d9 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26322025-07-18T00:02:09.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 50b3bcf6-18cb-4f34-af36-2520dd84e50d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26332025-07-18T00:02:09.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 50b3bcf6-18cb-4f34-af36-2520dd84e50d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26342025-07-18T00:02:09.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 50b3bcf6-18cb-4f34-af36-2520dd84e50d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26352025-07-18T00:02:10.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 125 reason = Timeout
26362025-07-18T00:02:10.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
26372025-07-18T00:02:10.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
26382025-07-18T00:02:10.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26392025-07-18T00:02:10.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
26402025-07-18T00:02:10.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
26412025-07-18T00:02:10.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
26422025-07-18T00:02:10.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
26432025-07-18T00:02:10.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
26442025-07-18T00:02:10.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26452025-07-18T00:02:10.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26462025-07-18T00:02:10.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26472025-07-18T00:02:10.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26482025-07-18T00:02:10.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
26492025-07-18T00:02:10.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.024903ms iteration = 125 status = {"chicken_switches_updated":false}
26502025-07-18T00:02:10.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26512025-07-18T00:02:10.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26522025-07-18T00:02:10.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26532025-07-18T00:02:10.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26542025-07-18T00:02:10.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26552025-07-18T00:02:10.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26562025-07-18T00:02:10.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26572025-07-18T00:02:10.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26582025-07-18T00:02:10.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26592025-07-18T00:02:10.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
26602025-07-18T00:02:10.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26612025-07-18T00:02:10.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26622025-07-18T00:02:10.240ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
26632025-07-18T00:02:10.240ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.992035ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
26642025-07-18T00:02:10.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.4153ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26652025-07-18T00:02:10.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6120c34e-f427-4874-9a75-9c28451dce4a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26662025-07-18T00:02:10.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6120c34e-f427-4874-9a75-9c28451dce4a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26672025-07-18T00:02:10.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6120c34e-f427-4874-9a75-9c28451dce4a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26682025-07-18T00:02:10.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 501 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 7375c684-af23-43fc-815e-1209edd9379b response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
26692025-07-18T00:02:11.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 44a1fe9f-9864-492f-989c-e186de8daa31 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26702025-07-18T00:02:11.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 44a1fe9f-9864-492f-989c-e186de8daa31 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26712025-07-18T00:02:11.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 44a1fe9f-9864-492f-989c-e186de8daa31 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26722025-07-18T00:02:12.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 39a86c3d-924a-4a87-9fd1-1ddbf4d94388 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26732025-07-18T00:02:12.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 39a86c3d-924a-4a87-9fd1-1ddbf4d94388 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26742025-07-18T00:02:12.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 39a86c3d-924a-4a87-9fd1-1ddbf4d94388 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26752025-07-18T00:02:14.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ab7ac3d3-2d66-483d-b9c3-5959e9d279f0 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26762025-07-18T00:02:14.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ab7ac3d3-2d66-483d-b9c3-5959e9d279f0 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26772025-07-18T00:02:14.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1787 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ab7ac3d3-2d66-483d-b9c3-5959e9d279f0 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26782025-07-18T00:02:15.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 768e906a-adda-4811-b455-c313e336a90b roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26792025-07-18T00:02:15.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 768e906a-adda-4811-b455-c313e336a90b resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26802025-07-18T00:02:15.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 768e906a-adda-4811-b455-c313e336a90b response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26812025-07-18T00:02:15.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 126 reason = Timeout
26822025-07-18T00:02:15.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
26832025-07-18T00:02:15.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
26842025-07-18T00:02:15.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26852025-07-18T00:02:15.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
26862025-07-18T00:02:15.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
26872025-07-18T00:02:15.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
26882025-07-18T00:02:15.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
26892025-07-18T00:02:15.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.116665ms iteration = 126 status = {"chicken_switches_updated":false}
26902025-07-18T00:02:16.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 60f47c8f-3ce5-4d4d-b84c-1bbfcd81477f roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26912025-07-18T00:02:16.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 60f47c8f-3ce5-4d4d-b84c-1bbfcd81477f resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26922025-07-18T00:02:16.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 60f47c8f-3ce5-4d4d-b84c-1bbfcd81477f response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26932025-07-18T00:02:17.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 21abd855-a0b8-459f-9a80-7af88877e7c0 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26942025-07-18T00:02:17.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 21abd855-a0b8-459f-9a80-7af88877e7c0 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26952025-07-18T00:02:17.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 21abd855-a0b8-459f-9a80-7af88877e7c0 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26962025-07-18T00:02:18.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c35bdff4-43ef-4329-ad14-80e19c8a5df9 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26972025-07-18T00:02:18.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c35bdff4-43ef-4329-ad14-80e19c8a5df9 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26982025-07-18T00:02:18.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c35bdff4-43ef-4329-ad14-80e19c8a5df9 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
26992025-07-18T00:02:19.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8b4dfc3d-ea38-4a1d-b81e-9ead2e52ba2c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
27002025-07-18T00:02:19.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8b4dfc3d-ea38-4a1d-b81e-9ead2e52ba2c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
27012025-07-18T00:02:19.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8b4dfc3d-ea38-4a1d-b81e-9ead2e52ba2c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
27022025-07-18T00:02:20.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 58e7542b-03e1-46cb-a81e-f1e9035845f6 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
27032025-07-18T00:02:20.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 58e7542b-03e1-46cb-a81e-f1e9035845f6 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
27042025-07-18T00:02:20.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 58e7542b-03e1-46cb-a81e-f1e9035845f6 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
27052025-07-18T00:02:20.207ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
27062025-07-18T00:02:20.207ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
27072025-07-18T00:02:20.207ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
27082025-07-18T00:02:20.207ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27092025-07-18T00:02:20.207ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27102025-07-18T00:02:20.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27112025-07-18T00:02:20.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27122025-07-18T00:02:20.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 127 reason = Timeout
27132025-07-18T00:02:20.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
27142025-07-18T00:02:20.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
27152025-07-18T00:02:20.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 288367844 } })
27162025-07-18T00:02:20.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 288386004 } })
27172025-07-18T00:02:20.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
27182025-07-18T00:02:20.211ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.407022ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27192025-07-18T00:02:20.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
27202025-07-18T00:02:20.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27212025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
27222025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
27232025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
27242025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27252025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27262025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27272025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
27282025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
27292025-07-18T00:02:20.215ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27302025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27312025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27322025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
27332025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27342025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
27352025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27362025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
27372025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27382025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
27392025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27402025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
27412025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
27422025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27432025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27442025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27452025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27462025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27472025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27482025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27492025-07-18T00:02:20.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27502025-07-18T00:02:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27512025-07-18T00:02:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27522025-07-18T00:02:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27532025-07-18T00:02:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27542025-07-18T00:02:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27552025-07-18T00:02:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27562025-07-18T00:02:20.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
27572025-07-18T00:02:20.217ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
27582025-07-18T00:02:20.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27592025-07-18T00:02:20.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
27602025-07-18T00:02:20.217ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27612025-07-18T00:02:20.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27622025-07-18T00:02:20.218ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27632025-07-18T00:02:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
27642025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27652025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
27662025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
27672025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27682025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27692025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27702025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
27712025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
27722025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
27732025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
27742025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 22 reason = Timeout
27752025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27762025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27772025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27782025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
27792025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27802025-07-18T00:02:20.219ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27812025-07-18T00:02:20.219ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 297497295 } })
27822025-07-18T00:02:20.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27832025-07-18T00:02:20.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27842025-07-18T00:02:20.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27852025-07-18T00:02:20.221ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27862025-07-18T00:02:20.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27872025-07-18T00:02:20.222ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27882025-07-18T00:02:20.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
27892025-07-18T00:02:20.223ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27902025-07-18T00:02:20.223ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
27912025-07-18T00:02:20.223ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 13.214904ms iteration = 127 status = {"chicken_switches_updated":false}
27922025-07-18T00:02:20.223ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27932025-07-18T00:02:20.223ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27942025-07-18T00:02:20.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27952025-07-18T00:02:20.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27962025-07-18T00:02:20.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27972025-07-18T00:02:20.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27982025-07-18T00:02:20.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27992025-07-18T00:02:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28002025-07-18T00:02:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28012025-07-18T00:02:20.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28022025-07-18T00:02:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28032025-07-18T00:02:20.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28042025-07-18T00:02:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28052025-07-18T00:02:20.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28062025-07-18T00:02:20.225ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28072025-07-18T00:02:20.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28082025-07-18T00:02:20.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28092025-07-18T00:02:20.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28102025-07-18T00:02:20.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28112025-07-18T00:02:20.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28122025-07-18T00:02:20.228ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 9.042359ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
28132025-07-18T00:02:20.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28142025-07-18T00:02:20.229ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28152025-07-18T00:02:20.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28162025-07-18T00:02:20.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28172025-07-18T00:02:20.230ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28182025-07-18T00:02:20.230ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 308707657 } })
28192025-07-18T00:02:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28202025-07-18T00:02:20.231ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
28212025-07-18T00:02:20.290ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28222025-07-18T00:02:20.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28232025-07-18T00:02:20.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.083591ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
28242025-07-18T00:02:20.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.495208ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
28252025-07-18T00:02:20.296ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28262025-07-18T00:02:20.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28272025-07-18T00:02:20.297ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.546765ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28282025-07-18T00:02:20.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28292025-07-18T00:02:20.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28302025-07-18T00:02:20.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28312025-07-18T00:02:20.299ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28322025-07-18T00:02:20.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28332025-07-18T00:02:20.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28342025-07-18T00:02:20.300ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28352025-07-18T00:02:20.300ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28362025-07-18T00:02:20.300ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28372025-07-18T00:02:20.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28382025-07-18T00:02:20.300ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28392025-07-18T00:02:20.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28402025-07-18T00:02:20.300ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28412025-07-18T00:02:20.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28422025-07-18T00:02:20.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28432025-07-18T00:02:20.303ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28442025-07-18T00:02:20.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28452025-07-18T00:02:20.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28462025-07-18T00:02:20.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28472025-07-18T00:02:20.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28482025-07-18T00:02:20.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28492025-07-18T00:02:20.305ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28502025-07-18T00:02:20.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28512025-07-18T00:02:20.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
28522025-07-18T00:02:20.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28532025-07-18T00:02:20.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28542025-07-18T00:02:20.307ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28552025-07-18T00:02:20.307ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28562025-07-18T00:02:20.307ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.083038ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28572025-07-18T00:02:20.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
28582025-07-18T00:02:20.309ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28592025-07-18T00:02:20.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28602025-07-18T00:02:20.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28612025-07-18T00:02:20.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28622025-07-18T00:02:20.310ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28632025-07-18T00:02:20.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, lookup_type: ById(4a597d98-bd6a-42be-a09e-71b1fbba6de5) } result = Ok(())
28642025-07-18T00:02:20.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28652025-07-18T00:02:20.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28662025-07-18T00:02:20.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28672025-07-18T00:02:20.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28682025-07-18T00:02:20.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28692025-07-18T00:02:20.312ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.086245ms iteration = 22 status = 0
28702025-07-18T00:02:20.313ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28712025-07-18T00:02:20.313ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28722025-07-18T00:02:20.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28732025-07-18T00:02:20.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28742025-07-18T00:02:20.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28752025-07-18T00:02:20.317ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28762025-07-18T00:02:20.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28772025-07-18T00:02:20.325ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
28782025-07-18T00:02:20.325ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 110.375719ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
28792025-07-18T00:02:20.339ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
28802025-07-18T00:02:20.339ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28812025-07-18T00:02:20.340ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f719fae1-1ba4-4007-a471-289a25c6e7d1", "content-length": "26", "date": "Fri, 18 Jul 2025 00:02:20 GMT"} })
28822025-07-18T00:02:20.340ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28832025-07-18T00:02:20.341ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28842025-07-18T00:02:20.343ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 124.501286ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
28852025-07-18T00:02:20.344ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 125.265298ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28862025-07-18T00:02:20.355ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28872025-07-18T00:02:20.355ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28882025-07-18T00:02:20.355ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.363961ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28892025-07-18T00:02:20.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 143.742953ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28902025-07-18T00:02:20.362ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
28912025-07-18T00:02:20.362ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28922025-07-18T00:02:20.362ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53a99dfd-92b1-4839-9c38-a79c09371e95", "content-length": "26", "date": "Fri, 18 Jul 2025 00:02:20 GMT"} })
28932025-07-18T00:02:20.362ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28942025-07-18T00:02:20.364ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28952025-07-18T00:02:20.364ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:389
28962025-07-18T00:02:20.364ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 148.802051ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
28972025-07-18T00:02:20.370ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 154.625091ms iteration = 25 status = {"physical_disks_added":0}
28982025-07-18T00:02:20.467ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 zone_address = fd00:1122:3344:101::2
28992025-07-18T00:02:20.467ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29002025-07-18T00:02:20.467ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a5247cb-25d3-445f-be89-40f819d0e1d0", "content-length": "26", "date": "Fri, 18 Jul 2025 00:02:20 GMT"} })
29012025-07-18T00:02:20.467ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29022025-07-18T00:02:20.469ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
29032025-07-18T00:02:20.486ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
29042025-07-18T00:02:20.487ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b477fe4-c916-4945-8e73-47a3865bd818", "content-length": "78", "date": "Fri, 18 Jul 2025 00:02:20 GMT"} })
29052025-07-18T00:02:20.487ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
29062025-07-18T00:02:20.487ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
29072025-07-18T00:02:20.487ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
29082025-07-18T00:02:20.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
29092025-07-18T00:02:20.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
29102025-07-18T00:02:20.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
29112025-07-18T00:02:20.489ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
29122025-07-18T00:02:20.489ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
29132025-07-18T00:02:20.490ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
29142025-07-18T00:02:20.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
29152025-07-18T00:02:20.492ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
29162025-07-18T00:02:20.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
29172025-07-18T00:02:20.492ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
29182025-07-18T00:02:20.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
29192025-07-18T00:02:20.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
29202025-07-18T00:02:20.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
29212025-07-18T00:02:20.492ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
29222025-07-18T00:02:20.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
29232025-07-18T00:02:20.494ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 287.09731ms iteration = 22 status = {}
29242025-07-18T00:02:20.495ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
29252025-07-18T00:02:20.495ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
29262025-07-18T00:02:20.495ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "83981485-5089-44cc-91a7-edc52b6fd4a8", "content-length": "81", "date": "Fri, 18 Jul 2025 00:02:20 GMT"} })
29272025-07-18T00:02:20.535ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
29282025-07-18T00:02:20.535ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
29292025-07-18T00:02:20.536ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "575ea3a2-82c4-4ac2-9d44-d75bede47b21", "content-length": "81", "date": "Fri, 18 Jul 2025 00:02:20 GMT"} })
29302025-07-18T00:02:20.539ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
29312025-07-18T00:02:20.539ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
29322025-07-18T00:02:20.539ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e75e1f6-73c4-40ee-a263-5255b7a64ac1", "content-length": "81", "date": "Fri, 18 Jul 2025 00:02:20 GMT"} })
29332025-07-18T00:02:20.541ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 322.887701ms iteration = 22 status = {"errors":[],"sps":[]}
29342025-07-18T00:02:20.542ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29352025-07-18T00:02:20.542ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29362025-07-18T00:02:20.542ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc368c3b-5090-47f2-89db-d94d06bea2d7", "content-length": "372", "date": "Fri, 18 Jul 2025 00:02:20 GMT"} })
29372025-07-18T00:02:20.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29382025-07-18T00:02:20.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29392025-07-18T00:02:20.550ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29402025-07-18T00:02:20.550ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "17e7231d-3a0b-4881-ba48-67454e9d9bf0", "content-length": "691", "date": "Fri, 18 Jul 2025 00:02:20 GMT"} })
29412025-07-18T00:02:20.550ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
29422025-07-18T00:02:20.550ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
29432025-07-18T00:02:20.550ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
29442025-07-18T00:02:20.552ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 336.933148ms iteration = 22 status = {}
29452025-07-18T00:02:20.566ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
29462025-07-18T00:02:20.566ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29472025-07-18T00:02:20.567ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7e46e4cc-d801-4d3a-8c8d-6dc915ca6abb", "date": "Fri, 18 Jul 2025 00:02:20 GMT"} })
29482025-07-18T00:02:20.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29492025-07-18T00:02:20.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29502025-07-18T00:02:20.568ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29512025-07-18T00:02:20.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29522025-07-18T00:02:20.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29532025-07-18T00:02:20.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29542025-07-18T00:02:20.571ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 363.457636ms iteration = 22 status = null
29552025-07-18T00:02:20.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29562025-07-18T00:02:20.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29572025-07-18T00:02:20.577ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29582025-07-18T00:02:20.577ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29592025-07-18T00:02:20.578ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "59049569-5702-4d31-ac3d-d11e2f05f3a6", "date": "Fri, 18 Jul 2025 00:02:20 GMT"} })
29602025-07-18T00:02:20.579ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 364.235017ms iteration = 22 status = {}
29612025-07-18T00:02:20.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29622025-07-18T00:02:20.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29632025-07-18T00:02:20.635ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a2d734dc-e0c9-4fd6-b442-f2c4e63791e5, rack_id: e4e73d6b-d53c-414c-93a8-eff1ed3c4807, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(9d790dba-5335-4b4c-be2a-58416dc1e8f5) } rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
29642025-07-18T00:02:20.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29652025-07-18T00:02:20.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29662025-07-18T00:02:20.649ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
29672025-07-18T00:02:20.649ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 9d790dba-5335-4b4c-be2a-58416dc1e8f5
29682025-07-18T00:02:20.649ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29692025-07-18T00:02:20.649ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29702025-07-18T00:02:20.649ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29712025-07-18T00:02:20.649ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29722025-07-18T00:02:20.649ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29732025-07-18T00:02:20.649ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29742025-07-18T00:02:20.649ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29752025-07-18T00:02:20.649ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29762025-07-18T00:02:20.650ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
29772025-07-18T00:02:20.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29782025-07-18T00:02:20.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29792025-07-18T00:02:20.652ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
29802025-07-18T00:02:20.652ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29812025-07-18T00:02:20.759ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "38778fcf-2423-4d3f-b988-10eb90358a88", "date": "Fri, 18 Jul 2025 00:02:20 GMT"} })
29822025-07-18T00:02:20.759ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch = Switch0
29832025-07-18T00:02:20.759ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29842025-07-18T00:02:20.765ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2660662-385a-47c5-b4ef-34b3ccbcf7ca", "content-length": "682", "date": "Fri, 18 Jul 2025 00:02:20 GMT"} })
29852025-07-18T00:02:20.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29862025-07-18T00:02:20.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29872025-07-18T00:02:20.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29882025-07-18T00:02:20.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29892025-07-18T00:02:20.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29902025-07-18T00:02:20.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29912025-07-18T00:02:20.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29922025-07-18T00:02:20.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29932025-07-18T00:02:20.784ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 569.131642ms iteration = 22 status = {}
29942025-07-18T00:02:20.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 606 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 273506fe-c6ad-4441-9885-1995d4f5825d response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
29952025-07-18T00:02:21.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5560d2ca-42f8-409e-9131-299094e97d8a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
29962025-07-18T00:02:21.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5560d2ca-42f8-409e-9131-299094e97d8a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
29972025-07-18T00:02:21.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5560d2ca-42f8-409e-9131-299094e97d8a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
29982025-07-18T00:02:22.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = aa3eeffa-fc96-48a5-8d37-933dbeef733a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
29992025-07-18T00:02:22.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = aa3eeffa-fc96-48a5-8d37-933dbeef733a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30002025-07-18T00:02:22.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = aa3eeffa-fc96-48a5-8d37-933dbeef733a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30012025-07-18T00:02:23.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0e225ac8-41d2-4d8d-b920-c023434a8f86 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30022025-07-18T00:02:23.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0e225ac8-41d2-4d8d-b920-c023434a8f86 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30032025-07-18T00:02:23.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0e225ac8-41d2-4d8d-b920-c023434a8f86 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30042025-07-18T00:02:24.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a5f96be3-a8a8-4799-af54-3981fc99740b roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30052025-07-18T00:02:24.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a5f96be3-a8a8-4799-af54-3981fc99740b resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30062025-07-18T00:02:24.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a5f96be3-a8a8-4799-af54-3981fc99740b response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30072025-07-18T00:02:25.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 43952589-8949-4c07-ab9a-33e99cb99e67 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30082025-07-18T00:02:25.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 43952589-8949-4c07-ab9a-33e99cb99e67 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30092025-07-18T00:02:25.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 43952589-8949-4c07-ab9a-33e99cb99e67 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30102025-07-18T00:02:25.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 128 reason = Timeout
30112025-07-18T00:02:25.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
30122025-07-18T00:02:25.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
30132025-07-18T00:02:25.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30142025-07-18T00:02:25.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
30152025-07-18T00:02:25.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
30162025-07-18T00:02:25.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
30172025-07-18T00:02:25.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
30182025-07-18T00:02:25.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.853651ms iteration = 128 status = {"chicken_switches_updated":false}
30192025-07-18T00:02:26.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8c4abc6b-4f60-46a3-b753-9c3926b67680 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30202025-07-18T00:02:26.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8c4abc6b-4f60-46a3-b753-9c3926b67680 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30212025-07-18T00:02:26.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8c4abc6b-4f60-46a3-b753-9c3926b67680 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30222025-07-18T00:02:27.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1e4bb8a6-aac4-40cb-9bf2-36e57829c59b roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30232025-07-18T00:02:27.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1e4bb8a6-aac4-40cb-9bf2-36e57829c59b resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30242025-07-18T00:02:27.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1e4bb8a6-aac4-40cb-9bf2-36e57829c59b response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30252025-07-18T00:02:28.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0b178c10-d009-4f10-a1e6-35b4949b761a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30262025-07-18T00:02:28.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0b178c10-d009-4f10-a1e6-35b4949b761a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30272025-07-18T00:02:28.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0b178c10-d009-4f10-a1e6-35b4949b761a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30282025-07-18T00:02:29.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a6f2a41e-cfd1-47ce-9d38-f09cd393d600 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30292025-07-18T00:02:29.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a6f2a41e-cfd1-47ce-9d38-f09cd393d600 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30302025-07-18T00:02:29.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a6f2a41e-cfd1-47ce-9d38-f09cd393d600 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30312025-07-18T00:02:30.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 129 reason = Timeout
30322025-07-18T00:02:30.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
30332025-07-18T00:02:30.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
30342025-07-18T00:02:30.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30352025-07-18T00:02:30.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
30362025-07-18T00:02:30.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
30372025-07-18T00:02:30.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
30382025-07-18T00:02:30.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
30392025-07-18T00:02:30.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
30402025-07-18T00:02:30.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30412025-07-18T00:02:30.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30422025-07-18T00:02:30.215ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
30432025-07-18T00:02:30.215ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.161144ms iteration = 129 status = {"chicken_switches_updated":false}
30442025-07-18T00:02:30.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30452025-07-18T00:02:30.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30462025-07-18T00:02:30.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30472025-07-18T00:02:30.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30482025-07-18T00:02:30.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30492025-07-18T00:02:30.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30502025-07-18T00:02:30.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30512025-07-18T00:02:30.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30522025-07-18T00:02:30.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30532025-07-18T00:02:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
30542025-07-18T00:02:30.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30552025-07-18T00:02:30.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30562025-07-18T00:02:30.235ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
30572025-07-18T00:02:30.235ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.661993ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
30582025-07-18T00:02:30.255ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30592025-07-18T00:02:30.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30602025-07-18T00:02:30.257ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.311226ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30612025-07-18T00:02:30.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = dda31fa4-a6fc-45a4-b2a7-b61ca9023d94 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30622025-07-18T00:02:30.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = dda31fa4-a6fc-45a4-b2a7-b61ca9023d94 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30632025-07-18T00:02:30.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = dda31fa4-a6fc-45a4-b2a7-b61ca9023d94 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30642025-07-18T00:02:30.978ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 567 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 7160f80c-6803-45a8-8e0e-4977f645a90d response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
30652025-07-18T00:02:31.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0ff3cf98-9b8d-4d1e-a95e-7fe4aa5ed12b roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30662025-07-18T00:02:31.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0ff3cf98-9b8d-4d1e-a95e-7fe4aa5ed12b resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30672025-07-18T00:02:31.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0ff3cf98-9b8d-4d1e-a95e-7fe4aa5ed12b response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30682025-07-18T00:02:32.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7c94e678-8a4a-4ed9-b1e9-85febc4e245a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30692025-07-18T00:02:32.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7c94e678-8a4a-4ed9-b1e9-85febc4e245a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30702025-07-18T00:02:32.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7c94e678-8a4a-4ed9-b1e9-85febc4e245a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30712025-07-18T00:02:33.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = eaeefa17-3c12-48e5-b6a0-333cd93633aa roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30722025-07-18T00:02:33.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = eaeefa17-3c12-48e5-b6a0-333cd93633aa resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30732025-07-18T00:02:33.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = eaeefa17-3c12-48e5-b6a0-333cd93633aa response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30742025-07-18T00:02:34.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4be90a3a-7d6c-471f-b1a0-e4d4456d1b9a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30752025-07-18T00:02:34.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4be90a3a-7d6c-471f-b1a0-e4d4456d1b9a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30762025-07-18T00:02:34.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4be90a3a-7d6c-471f-b1a0-e4d4456d1b9a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30772025-07-18T00:02:35.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 130 reason = Timeout
30782025-07-18T00:02:35.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
30792025-07-18T00:02:35.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
30802025-07-18T00:02:35.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30812025-07-18T00:02:35.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
30822025-07-18T00:02:35.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
30832025-07-18T00:02:35.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
30842025-07-18T00:02:35.215ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
30852025-07-18T00:02:35.215ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.50849ms iteration = 130 status = {"chicken_switches_updated":false}
30862025-07-18T00:02:35.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 036c65de-eb3f-4a80-a2db-49b6ae0124fa roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30872025-07-18T00:02:35.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 036c65de-eb3f-4a80-a2db-49b6ae0124fa resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30882025-07-18T00:02:35.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 036c65de-eb3f-4a80-a2db-49b6ae0124fa response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30892025-07-18T00:02:35.964ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:38445
30902025-07-18T00:02:35.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38445 req_id = 22974a99-f79e-404a-a84d-bd412153af0f roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
30912025-07-18T00:02:35.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38445 req_id = 22974a99-f79e-404a-a84d-bd412153af0f resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
30922025-07-18T00:02:35.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38445 req_id = 22974a99-f79e-404a-a84d-bd412153af0f response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
30932025-07-18T00:02:35.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38445 req_id = f98a567f-b9ef-442f-a2e7-82082596f61c roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
30942025-07-18T00:02:35.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38445 req_id = f98a567f-b9ef-442f-a2e7-82082596f61c resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
30952025-07-18T00:02:35.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2599 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38445 req_id = f98a567f-b9ef-442f-a2e7-82082596f61c response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
30962025-07-18T00:02:36.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2606c045-8a5a-4783-8dba-c5c24c647f06 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30972025-07-18T00:02:36.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2606c045-8a5a-4783-8dba-c5c24c647f06 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30982025-07-18T00:02:36.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2606c045-8a5a-4783-8dba-c5c24c647f06 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
30992025-07-18T00:02:37.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0fbd36fc-ad8a-4d22-8976-c48b29f17f86 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31002025-07-18T00:02:37.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0fbd36fc-ad8a-4d22-8976-c48b29f17f86 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31012025-07-18T00:02:37.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0fbd36fc-ad8a-4d22-8976-c48b29f17f86 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31022025-07-18T00:02:38.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 93b9d789-bb9d-4b69-a2e1-a8f1890c4df0 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31032025-07-18T00:02:38.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 93b9d789-bb9d-4b69-a2e1-a8f1890c4df0 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31042025-07-18T00:02:38.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 93b9d789-bb9d-4b69-a2e1-a8f1890c4df0 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31052025-07-18T00:02:39.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ed4e259b-e305-45ab-9bbc-6425487f3eeb roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31062025-07-18T00:02:39.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ed4e259b-e305-45ab-9bbc-6425487f3eeb resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31072025-07-18T00:02:39.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ed4e259b-e305-45ab-9bbc-6425487f3eeb response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31082025-07-18T00:02:40.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 131 reason = Timeout
31092025-07-18T00:02:40.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
31102025-07-18T00:02:40.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
31112025-07-18T00:02:40.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31122025-07-18T00:02:40.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
31132025-07-18T00:02:40.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
31142025-07-18T00:02:40.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
31152025-07-18T00:02:40.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
31162025-07-18T00:02:40.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
31172025-07-18T00:02:40.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31182025-07-18T00:02:40.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31192025-07-18T00:02:40.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31202025-07-18T00:02:40.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31212025-07-18T00:02:40.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
31222025-07-18T00:02:40.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.788865ms iteration = 131 status = {"chicken_switches_updated":false}
31232025-07-18T00:02:40.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31242025-07-18T00:02:40.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31252025-07-18T00:02:40.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31262025-07-18T00:02:40.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.097813ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31272025-07-18T00:02:40.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31282025-07-18T00:02:40.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31292025-07-18T00:02:40.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31302025-07-18T00:02:40.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31312025-07-18T00:02:40.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31322025-07-18T00:02:40.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31332025-07-18T00:02:40.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
31342025-07-18T00:02:40.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31352025-07-18T00:02:40.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31362025-07-18T00:02:40.233ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
31372025-07-18T00:02:40.233ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.683537ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
31382025-07-18T00:02:40.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7d1f19fd-800b-4f56-98a3-742c3815e9da roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31392025-07-18T00:02:40.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7d1f19fd-800b-4f56-98a3-742c3815e9da resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31402025-07-18T00:02:40.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7d1f19fd-800b-4f56-98a3-742c3815e9da response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31412025-07-18T00:02:40.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 952 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = ca2de5c6-f79d-40f4-91ff-8c6a03b9acbe response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
31422025-07-18T00:02:41.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = abe65111-578c-45a3-b585-0202bddf1deb roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31432025-07-18T00:02:41.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = abe65111-578c-45a3-b585-0202bddf1deb resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31442025-07-18T00:02:41.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = abe65111-578c-45a3-b585-0202bddf1deb response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31452025-07-18T00:02:42.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 540dbaaa-c5bc-46bc-aaa7-4cd59e647e25 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31462025-07-18T00:02:42.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 540dbaaa-c5bc-46bc-aaa7-4cd59e647e25 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31472025-07-18T00:02:42.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 540dbaaa-c5bc-46bc-aaa7-4cd59e647e25 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31482025-07-18T00:02:43.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f01f1246-7a56-4d77-b51a-276dd74ed97c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31492025-07-18T00:02:43.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f01f1246-7a56-4d77-b51a-276dd74ed97c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31502025-07-18T00:02:43.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f01f1246-7a56-4d77-b51a-276dd74ed97c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31512025-07-18T00:02:44.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9c8bf078-e8a9-4684-b9da-0f9a0339390d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31522025-07-18T00:02:44.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9c8bf078-e8a9-4684-b9da-0f9a0339390d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31532025-07-18T00:02:44.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9c8bf078-e8a9-4684-b9da-0f9a0339390d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31542025-07-18T00:02:45.208ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 132 reason = Timeout
31552025-07-18T00:02:45.208ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
31562025-07-18T00:02:45.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
31572025-07-18T00:02:45.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31582025-07-18T00:02:45.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
31592025-07-18T00:02:45.213ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
31602025-07-18T00:02:45.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
31612025-07-18T00:02:45.214ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
31622025-07-18T00:02:45.214ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.275667ms iteration = 132 status = {"chicken_switches_updated":false}
31632025-07-18T00:02:45.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f51667bf-81dc-401e-a0df-348709732595 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31642025-07-18T00:02:45.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f51667bf-81dc-401e-a0df-348709732595 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31652025-07-18T00:02:45.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f51667bf-81dc-401e-a0df-348709732595 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31662025-07-18T00:02:46.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = aa951938-8cca-4ca3-ad2f-5aaa205aab66 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31672025-07-18T00:02:46.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = aa951938-8cca-4ca3-ad2f-5aaa205aab66 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31682025-07-18T00:02:46.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = aa951938-8cca-4ca3-ad2f-5aaa205aab66 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31692025-07-18T00:02:47.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7a1f869c-2b57-491b-8f2b-90065d73a3f7 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31702025-07-18T00:02:47.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7a1f869c-2b57-491b-8f2b-90065d73a3f7 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31712025-07-18T00:02:47.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7a1f869c-2b57-491b-8f2b-90065d73a3f7 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31722025-07-18T00:02:48.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2f3729c9-da08-4a17-9d14-8f583bcc4378 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31732025-07-18T00:02:48.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2f3729c9-da08-4a17-9d14-8f583bcc4378 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31742025-07-18T00:02:48.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2f3729c9-da08-4a17-9d14-8f583bcc4378 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31752025-07-18T00:02:49.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 235d1292-1794-46c9-b21a-b6d70c068654 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31762025-07-18T00:02:49.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 235d1292-1794-46c9-b21a-b6d70c068654 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31772025-07-18T00:02:49.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 235d1292-1794-46c9-b21a-b6d70c068654 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
31782025-07-18T00:02:50.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
31792025-07-18T00:02:50.205ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31802025-07-18T00:02:50.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31812025-07-18T00:02:50.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31822025-07-18T00:02:50.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31832025-07-18T00:02:50.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31842025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
31852025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
31862025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
31872025-07-18T00:02:50.207ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-17 23:52:50.207486931 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
31882025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
31892025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
31902025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
31912025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
31922025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
31932025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31942025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31952025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
31962025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31972025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
31982025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
31992025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32002025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32012025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
32022025-07-18T00:02:50.207ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 9092da00-a622-42cf-99af-453ea64d4a35
32032025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.01\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"9092da00-a622-42cf-99af-453ea64d4a35"}
32042025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32052025-07-18T00:02:50.207ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("464a3447-fe1f-417e-b585-925f5fb5bfdc.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da3261f0-45ba-4fbf-b6bb-a5a70850db80.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("da3261f0-45ba-4fbf-b6bb-a5a70850db80.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 286127150 } })
32062025-07-18T00:02:50.207ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("56b8d8b3-74d8-49ff-9bba-ff575bfeff38.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b6789fb-7f6d-466d-9e8d-08234eb15cb4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eee78e3b-9d92-4bbf-a496-9511487338e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("eee78e3b-9d92-4bbf-a496-9511487338e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:3::1)) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 286188611 } })
32072025-07-18T00:02:50.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32082025-07-18T00:02:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32092025-07-18T00:02:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32102025-07-18T00:02:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32112025-07-18T00:02:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32122025-07-18T00:02:50.208ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
32132025-07-18T00:02:50.208ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 848.843\u{b5}s iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
32142025-07-18T00:02:50.208ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
32152025-07-18T00:02:50.208ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.029586ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
32162025-07-18T00:02:50.208ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 16 reason = Timeout
32172025-07-18T00:02:50.208ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
32182025-07-18T00:02:50.208ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 8.38\u{b5}s iteration = 16 status = "Disabled"
32192025-07-18T00:02:50.208ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 133 reason = Timeout
32202025-07-18T00:02:50.208ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
32212025-07-18T00:02:50.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
32222025-07-18T00:02:50.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32232025-07-18T00:02:50.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32242025-07-18T00:02:50.210ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-17 23:52:50.207486931 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32252025-07-18T00:02:50.210ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.698151ms iteration = 12 status = {"expiration":"2025-07-17T23:52:50.207486931Z","pruned":[]}
32262025-07-18T00:02:50.211ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.938681ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32272025-07-18T00:02:50.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 290046990 } })
32282025-07-18T00:02:50.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32292025-07-18T00:02:50.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32302025-07-18T00:02:50.212ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
32312025-07-18T00:02:50.212ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 290493377 } })
32322025-07-18T00:02:50.212ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32332025-07-18T00:02:50.212ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
32342025-07-18T00:02:50.213ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32352025-07-18T00:02:50.213ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
32362025-07-18T00:02:50.213ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
32372025-07-18T00:02:50.213ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
32382025-07-18T00:02:50.213ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32392025-07-18T00:02:50.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32402025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
32412025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
32422025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32432025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
32442025-07-18T00:02:50.215ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32452025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32462025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32472025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
32482025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
32492025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32502025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32512025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
32522025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32532025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
32542025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
32552025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32562025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32572025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
32582025-07-18T00:02:50.215ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
32592025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
32602025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32612025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32622025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
32632025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32642025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32652025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
32662025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32672025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
32682025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32692025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
32702025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32712025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32722025-07-18T00:02:50.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32732025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32742025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32752025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32762025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32772025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32782025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32792025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32802025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32812025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32822025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32832025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32842025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32852025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32862025-07-18T00:02:50.216ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32872025-07-18T00:02:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32882025-07-18T00:02:50.217ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
32892025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
32902025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
32912025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32922025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
32932025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32942025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
32952025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32962025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32972025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
32982025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
32992025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33002025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33012025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33022025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
33032025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33042025-07-18T00:02:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33052025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 12 reason = Timeout
33062025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
33072025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
33082025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
33092025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
33102025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33112025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 23 reason = Timeout
33122025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 12 reason = Timeout
33132025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
33142025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33152025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
33162025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33172025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
33182025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
33192025-07-18T00:02:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33202025-07-18T00:02:50.219ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 297950222 } })
33212025-07-18T00:02:50.220ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33222025-07-18T00:02:50.221ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33232025-07-18T00:02:50.221ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33242025-07-18T00:02:50.221ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.566826ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33252025-07-18T00:02:50.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33262025-07-18T00:02:50.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33272025-07-18T00:02:50.221ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33282025-07-18T00:02:50.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33292025-07-18T00:02:50.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33302025-07-18T00:02:50.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33312025-07-18T00:02:50.224ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33322025-07-18T00:02:50.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33332025-07-18T00:02:50.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33342025-07-18T00:02:50.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
33352025-07-18T00:02:50.225ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33362025-07-18T00:02:50.225ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33372025-07-18T00:02:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33382025-07-18T00:02:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33392025-07-18T00:02:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33402025-07-18T00:02:50.228ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33412025-07-18T00:02:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33422025-07-18T00:02:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33432025-07-18T00:02:50.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33442025-07-18T00:02:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
33452025-07-18T00:02:50.229ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33462025-07-18T00:02:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33472025-07-18T00:02:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33482025-07-18T00:02:50.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33492025-07-18T00:02:50.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33502025-07-18T00:02:50.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33512025-07-18T00:02:50.232ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33522025-07-18T00:02:50.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33532025-07-18T00:02:50.234ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.776609ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
33542025-07-18T00:02:50.235ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
33552025-07-18T00:02:50.235ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 26.981396ms iteration = 133 status = {"chicken_switches_updated":false}
33562025-07-18T00:02:50.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.718943ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
33572025-07-18T00:02:50.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33582025-07-18T00:02:50.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33592025-07-18T00:02:50.249ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
33602025-07-18T00:02:50.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33612025-07-18T00:02:50.249ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 30.250305ms iteration = 12 status = {"by_rx":{},"error":null}
33622025-07-18T00:02:50.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33632025-07-18T00:02:50.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33642025-07-18T00:02:50.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33652025-07-18T00:02:50.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33662025-07-18T00:02:50.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33672025-07-18T00:02:50.258ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33682025-07-18T00:02:50.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33692025-07-18T00:02:50.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33702025-07-18T00:02:50.263ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33712025-07-18T00:02:50.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33722025-07-18T00:02:50.265ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
33732025-07-18T00:02:50.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
33742025-07-18T00:02:50.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
33752025-07-18T00:02:50.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33762025-07-18T00:02:50.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33772025-07-18T00:02:50.272ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 349960462 } })
33782025-07-18T00:02:50.272ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
33792025-07-18T00:02:50.275ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 56.477589ms iteration = 12 status = {"dispatched":[],"errors":[],"glob_version":"165.0.0","globs_reprocessed":{},"no_receivers":[]}
33802025-07-18T00:02:50.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33812025-07-18T00:02:50.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33822025-07-18T00:02:50.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33832025-07-18T00:02:50.293ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33842025-07-18T00:02:50.293ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33852025-07-18T00:02:50.293ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33862025-07-18T00:02:50.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33872025-07-18T00:02:50.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33882025-07-18T00:02:50.296ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33892025-07-18T00:02:50.297ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33902025-07-18T00:02:50.297ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33912025-07-18T00:02:50.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33922025-07-18T00:02:50.300ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
33932025-07-18T00:02:50.300ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.692334ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
33942025-07-18T00:02:50.300ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 81.344122ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
33952025-07-18T00:02:50.301ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33962025-07-18T00:02:50.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33972025-07-18T00:02:50.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33982025-07-18T00:02:50.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
33992025-07-18T00:02:50.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34002025-07-18T00:02:50.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34012025-07-18T00:02:50.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34022025-07-18T00:02:50.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34032025-07-18T00:02:50.317ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 101.93254ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34042025-07-18T00:02:50.322ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
34052025-07-18T00:02:50.322ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
34062025-07-18T00:02:50.322ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
34072025-07-18T00:02:50.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34082025-07-18T00:02:50.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34092025-07-18T00:02:50.322ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34102025-07-18T00:02:50.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34112025-07-18T00:02:50.325ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 107.938832ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
34122025-07-18T00:02:50.327ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34132025-07-18T00:02:50.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34142025-07-18T00:02:50.327ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
34152025-07-18T00:02:50.327ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
34162025-07-18T00:02:50.327ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 112.247598ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
34172025-07-18T00:02:50.334ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34182025-07-18T00:02:50.335ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 117.910045ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34192025-07-18T00:02:50.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34202025-07-18T00:02:50.337ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34212025-07-18T00:02:50.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34222025-07-18T00:02:50.338ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34232025-07-18T00:02:50.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34242025-07-18T00:02:50.344ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34252025-07-18T00:02:50.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34262025-07-18T00:02:50.347ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34272025-07-18T00:02:50.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34282025-07-18T00:02:50.358ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34292025-07-18T00:02:50.358ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 142.964191ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34302025-07-18T00:02:50.358ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34312025-07-18T00:02:50.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34322025-07-18T00:02:50.361ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34332025-07-18T00:02:50.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
34342025-07-18T00:02:50.363ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34352025-07-18T00:02:50.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34362025-07-18T00:02:50.365ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34372025-07-18T00:02:50.365ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2be4d985-6e68-40d2-a5d1-ba1e291e5f99 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34382025-07-18T00:02:50.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34392025-07-18T00:02:50.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34402025-07-18T00:02:50.366ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34412025-07-18T00:02:50.366ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34422025-07-18T00:02:50.366ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 150.73329ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34432025-07-18T00:02:50.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34442025-07-18T00:02:50.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34452025-07-18T00:02:50.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34462025-07-18T00:02:50.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34472025-07-18T00:02:50.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34482025-07-18T00:02:50.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34492025-07-18T00:02:50.376ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2be4d985-6e68-40d2-a5d1-ba1e291e5f99 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
34502025-07-18T00:02:50.376ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
34512025-07-18T00:02:50.376ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-17 23:52:10.609253 UTC dns_group = internal generation = 1
34522025-07-18T00:02:50.376ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 171.715443ms iteration = 12 status = {"generation":1}
34532025-07-18T00:02:50.379ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
34542025-07-18T00:02:50.379ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34552025-07-18T00:02:50.380ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7042ad34-62ae-4330-9e29-047842948b4c", "content-length": "26", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
34562025-07-18T00:02:50.380ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34572025-07-18T00:02:50.382ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34582025-07-18T00:02:50.384ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34592025-07-18T00:02:50.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34602025-07-18T00:02:50.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34612025-07-18T00:02:50.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34622025-07-18T00:02:50.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34632025-07-18T00:02:50.399ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
34642025-07-18T00:02:50.400ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34652025-07-18T00:02:50.400ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34662025-07-18T00:02:50.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34672025-07-18T00:02:50.405ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34682025-07-18T00:02:50.405ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 189.69738ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34692025-07-18T00:02:50.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34702025-07-18T00:02:50.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, lookup_type: ById(4a597d98-bd6a-42be-a09e-71b1fbba6de5) } result = Ok(())
34712025-07-18T00:02:50.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34722025-07-18T00:02:50.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34732025-07-18T00:02:50.410ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
34742025-07-18T00:02:50.410ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a5c2ae61-5a10-495b-8726-f2f7ed24b4a0 dns_zone_name = oxide.test found_so_far = 0 version = 2
34752025-07-18T00:02:50.410ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34762025-07-18T00:02:50.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34772025-07-18T00:02:50.412ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 197.302968ms iteration = 23 status = 0
34782025-07-18T00:02:50.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34792025-07-18T00:02:50.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34802025-07-18T00:02:50.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34812025-07-18T00:02:50.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34822025-07-18T00:02:50.429ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-17T23:51:46.880014Z, time_modified: 2025-07-17T23:51:46.880014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f37123ec-61ff-4793-867b-6920b7f6246a, db_silo: Silo { identity: SiloIdentity { id: f37123ec-61ff-4793-867b-6920b7f6246a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-17T23:52:11.102986Z, time_modified: 2025-07-17T23:52:11.102986Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f37123ec-61ff-4793-867b-6920b7f6246a, db_silo: Silo { identity: SiloIdentity { id: f37123ec-61ff-4793-867b-6920b7f6246a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-17T23:52:11.102986Z, time_modified: 2025-07-17T23:52:11.102986Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3" }] }) }
34832025-07-18T00:02:50.430ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 222.423644ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f37123ec-61ff-4793-867b-6920b7f6246a","tls_certs":["6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3"]}},"default_endpoint":{"silo_id":"f37123ec-61ff-4793-867b-6920b7f6246a","tls_certs":["6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
34842025-07-18T00:02:50.437ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:389
34852025-07-18T00:02:50.437ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 222.095769ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
34862025-07-18T00:02:50.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34872025-07-18T00:02:50.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34882025-07-18T00:02:50.443ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 225.351829ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
34892025-07-18T00:02:50.447ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a5c2ae61-5a10-495b-8726-f2f7ed24b4a0 dns_zone_name = oxide.test found_so_far = 4 version = 2
34902025-07-18T00:02:50.447ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34912025-07-18T00:02:50.447ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-17 23:52:11.153706 UTC dns_group = external generation = 2
34922025-07-18T00:02:50.447ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 240.080226ms iteration = 12 status = {"generation":2}
34932025-07-18T00:02:50.451ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34942025-07-18T00:02:50.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34952025-07-18T00:02:50.454ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34962025-07-18T00:02:50.457ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34972025-07-18T00:02:50.457ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34982025-07-18T00:02:50.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34992025-07-18T00:02:50.463ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35002025-07-18T00:02:50.467ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35012025-07-18T00:02:50.467ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35022025-07-18T00:02:50.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35032025-07-18T00:02:50.470ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 zone_address = fd00:1122:3344:101::2
35042025-07-18T00:02:50.470ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35052025-07-18T00:02:50.470ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2316b3a-581a-44f0-a671-9a3f5bd4f1b9", "content-length": "26", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
35062025-07-18T00:02:50.470ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35072025-07-18T00:02:50.472ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
35082025-07-18T00:02:50.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35092025-07-18T00:02:50.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35102025-07-18T00:02:50.494ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
35112025-07-18T00:02:50.494ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "97bfb784-45c7-443d-bfd7-e9a32e69f78c", "content-length": "78", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
35122025-07-18T00:02:50.495ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
35132025-07-18T00:02:50.495ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
35142025-07-18T00:02:50.495ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
35152025-07-18T00:02:50.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
35162025-07-18T00:02:50.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
35172025-07-18T00:02:50.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
35182025-07-18T00:02:50.497ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
35192025-07-18T00:02:50.504ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
35202025-07-18T00:02:50.504ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
35212025-07-18T00:02:50.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
35222025-07-18T00:02:50.545ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
35232025-07-18T00:02:50.547ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 331.884849ms iteration = 26 status = {"physical_disks_added":0}
35242025-07-18T00:02:50.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
35252025-07-18T00:02:50.547ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
35262025-07-18T00:02:50.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
35272025-07-18T00:02:50.553ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
35282025-07-18T00:02:50.554ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 338.37219ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
35292025-07-18T00:02:50.556ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
35302025-07-18T00:02:50.559ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
35312025-07-18T00:02:50.559ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
35322025-07-18T00:02:50.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
35332025-07-18T00:02:50.561ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
35342025-07-18T00:02:50.561ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
35352025-07-18T00:02:50.562ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8db0271-e7d1-4541-9f87-1143d9c27374", "content-length": "81", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
35362025-07-18T00:02:50.571ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
35372025-07-18T00:02:50.571ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
35382025-07-18T00:02:50.571ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0257358-3d2e-4b50-ae91-164f2340046f", "content-length": "81", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
35392025-07-18T00:02:50.576ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
35402025-07-18T00:02:50.580ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
35412025-07-18T00:02:50.581ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35422025-07-18T00:02:50.581ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "28d2cef6-c317-404a-85fa-965858a79f99", "content-length": "26", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
35432025-07-18T00:02:50.581ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35442025-07-18T00:02:50.583ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35452025-07-18T00:02:50.588ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35462025-07-18T00:02:50.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35472025-07-18T00:02:50.590ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 383.016657ms iteration = 23 status = null
35482025-07-18T00:02:50.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2d695f85-47c2-43c7-a1b7-3a2556aa9e26 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
35492025-07-18T00:02:50.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2d695f85-47c2-43c7-a1b7-3a2556aa9e26 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
35502025-07-18T00:02:50.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2d695f85-47c2-43c7-a1b7-3a2556aa9e26 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
35512025-07-18T00:02:50.600ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35522025-07-18T00:02:50.600ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35532025-07-18T00:02:50.601ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a3becf4-34aa-45c1-964a-7bd80df342db", "content-length": "372", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
35542025-07-18T00:02:50.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35552025-07-18T00:02:50.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35562025-07-18T00:02:50.603ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35572025-07-18T00:02:50.604ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d3f298d8-adb5-4962-84bb-f06a4df46f83", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35582025-07-18T00:02:50.604ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35592025-07-18T00:02:50.607ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
35602025-07-18T00:02:50.607ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
35612025-07-18T00:02:50.609ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a23b3b2-0215-400b-b4cd-641cd127540c", "content-length": "81", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
35622025-07-18T00:02:50.610ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2818d155-528b-40c6-9268-c6d7c780e49e", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35632025-07-18T00:02:50.610ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35642025-07-18T00:02:50.613ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 394.062067ms iteration = 23 status = {"errors":[],"sps":[]}
35652025-07-18T00:02:50.615ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35662025-07-18T00:02:50.615ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 408.044742ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
35672025-07-18T00:02:50.628ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
35682025-07-18T00:02:50.628ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
35692025-07-18T00:02:50.629ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bcf5922a-c3ae-4e17-b035-f032fd77f5c2", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
35702025-07-18T00:02:50.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35712025-07-18T00:02:50.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35722025-07-18T00:02:50.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35732025-07-18T00:02:50.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35742025-07-18T00:02:50.635ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35752025-07-18T00:02:50.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35762025-07-18T00:02:50.640ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35772025-07-18T00:02:50.640ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35782025-07-18T00:02:50.640ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "20ba7f67-59ab-45f3-8a50-da40d3e0d0f7", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
35792025-07-18T00:02:50.642ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 427.161646ms iteration = 23 status = {}
35802025-07-18T00:02:50.693ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35812025-07-18T00:02:50.694ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ffc0fe76-57c2-4b90-9c0c-7022bd1582f8", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35822025-07-18T00:02:50.694ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35832025-07-18T00:02:50.695ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4d2ab6b6-56be-4c35-8e3d-14d7c2c8c146", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35842025-07-18T00:02:50.695ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35852025-07-18T00:02:50.698ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "38fc8513-d984-4c2b-9e66-1adc5480a856", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35862025-07-18T00:02:50.698ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35872025-07-18T00:02:50.698ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 491.152562ms iteration = 23 status = {}
35882025-07-18T00:02:50.700ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35892025-07-18T00:02:50.700ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 493.024021ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
35902025-07-18T00:02:50.710ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35912025-07-18T00:02:50.711ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d043c8bf-33a3-43b0-ad71-707082f1ac5d", "content-length": "691", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
35922025-07-18T00:02:50.711ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
35932025-07-18T00:02:50.711ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
35942025-07-18T00:02:50.711ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
35952025-07-18T00:02:50.713ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 497.817354ms iteration = 23 status = {}
35962025-07-18T00:02:50.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35972025-07-18T00:02:50.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35982025-07-18T00:02:50.744ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a2d734dc-e0c9-4fd6-b442-f2c4e63791e5, rack_id: e4e73d6b-d53c-414c-93a8-eff1ed3c4807, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(9d790dba-5335-4b4c-be2a-58416dc1e8f5) } rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
35992025-07-18T00:02:50.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36002025-07-18T00:02:50.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36012025-07-18T00:02:50.757ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
36022025-07-18T00:02:50.757ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 9d790dba-5335-4b4c-be2a-58416dc1e8f5
36032025-07-18T00:02:50.757ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36042025-07-18T00:02:50.757ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36052025-07-18T00:02:50.757ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36062025-07-18T00:02:50.757ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36072025-07-18T00:02:50.757ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36082025-07-18T00:02:50.757ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36092025-07-18T00:02:50.757ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36102025-07-18T00:02:50.757ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36112025-07-18T00:02:50.757ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
36122025-07-18T00:02:50.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36132025-07-18T00:02:50.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36142025-07-18T00:02:50.759ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
36152025-07-18T00:02:50.760ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36162025-07-18T00:02:50.884ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "18190e42-d6e7-4ee7-959e-95d7bdf946da", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
36172025-07-18T00:02:50.884ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch = Switch0
36182025-07-18T00:02:50.884ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36192025-07-18T00:02:50.892ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a26f2990-7eb3-49da-9e19-2c6015ad64c0", "content-length": "682", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
36202025-07-18T00:02:50.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36212025-07-18T00:02:50.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36222025-07-18T00:02:50.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36232025-07-18T00:02:50.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36242025-07-18T00:02:50.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36252025-07-18T00:02:50.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36262025-07-18T00:02:50.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36272025-07-18T00:02:50.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36282025-07-18T00:02:50.910ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 694.566083ms iteration = 23 status = {}
36292025-07-18T00:02:50.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 551 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 1e967150-581c-4ef8-b325-1af218d68206 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
36302025-07-18T00:02:51.213ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 4
36312025-07-18T00:02:51.213ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221
36322025-07-18T00:02:51.243ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
36332025-07-18T00:02:51.243ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:61855
36342025-07-18T00:02:51.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61855 req_id = b04f55ec-35a7-4463-826f-6fbdccae27cc roles = RoleSet { roles: {} } uri = /metrics/producers
36352025-07-18T00:02:51.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61855 req_id = b04f55ec-35a7-4463-826f-6fbdccae27cc resource = Database result = Ok(()) uri = /metrics/producers
36362025-07-18T00:02:51.294ZINFOnexus: assigned collector to new producer collector_id = 13431648-c0eb-4fbe-bcca-ada1fdea1060 file = nexus/src/app/oximeter.rs:76 producer_id = 79e7c92c-8e83-4180-bbfe-92325edee698
36372025-07-18T00:02:51.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 51243 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61855 req_id = b04f55ec-35a7-4463-826f-6fbdccae27cc response_code = 201 uri = /metrics/producers
36382025-07-18T00:02:51.294ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b04f55ec-35a7-4463-826f-6fbdccae27cc", "content-length": "41", "date": "Fri, 18 Jul 2025 00:02:50 GMT"} })
36392025-07-18T00:02:51.296ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
36402025-07-18T00:02:51.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7f086fa7-8242-436a-acd9-7fa6c11b200e roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36412025-07-18T00:02:51.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7f086fa7-8242-436a-acd9-7fa6c11b200e resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36422025-07-18T00:02:51.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7f086fa7-8242-436a-acd9-7fa6c11b200e response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36432025-07-18T00:02:52.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8344bdec-47ed-4736-8364-31833113ca41 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36442025-07-18T00:02:52.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8344bdec-47ed-4736-8364-31833113ca41 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36452025-07-18T00:02:52.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8344bdec-47ed-4736-8364-31833113ca41 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36462025-07-18T00:02:53.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 74041a66-ef9d-4f99-ae47-9af883844aee roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36472025-07-18T00:02:53.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 74041a66-ef9d-4f99-ae47-9af883844aee resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36482025-07-18T00:02:53.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 74041a66-ef9d-4f99-ae47-9af883844aee response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36492025-07-18T00:02:54.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f3859284-3f5a-4078-9317-70ee2e0a917b roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36502025-07-18T00:02:54.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f3859284-3f5a-4078-9317-70ee2e0a917b resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36512025-07-18T00:02:54.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f3859284-3f5a-4078-9317-70ee2e0a917b response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36522025-07-18T00:02:55.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 134 reason = Timeout
36532025-07-18T00:02:55.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
36542025-07-18T00:02:55.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
36552025-07-18T00:02:55.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36562025-07-18T00:02:55.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
36572025-07-18T00:02:55.213ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
36582025-07-18T00:02:55.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
36592025-07-18T00:02:55.215ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
36602025-07-18T00:02:55.215ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.320747ms iteration = 134 status = {"chicken_switches_updated":false}
36612025-07-18T00:02:55.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e8eb5b04-cb45-484f-9779-7b73b2e0e37d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36622025-07-18T00:02:55.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e8eb5b04-cb45-484f-9779-7b73b2e0e37d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36632025-07-18T00:02:55.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e8eb5b04-cb45-484f-9779-7b73b2e0e37d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36642025-07-18T00:02:56.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = afdd9403-96be-48fe-9f26-d0e7f520fc12 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36652025-07-18T00:02:56.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = afdd9403-96be-48fe-9f26-d0e7f520fc12 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36662025-07-18T00:02:56.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = afdd9403-96be-48fe-9f26-d0e7f520fc12 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36672025-07-18T00:02:57.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 238c1193-45a1-4065-b3b5-933febd4ce4d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36682025-07-18T00:02:57.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 238c1193-45a1-4065-b3b5-933febd4ce4d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36692025-07-18T00:02:57.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 238c1193-45a1-4065-b3b5-933febd4ce4d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36702025-07-18T00:02:58.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 252f4fd2-03a9-414f-aa32-eecfe54fb209 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36712025-07-18T00:02:58.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 252f4fd2-03a9-414f-aa32-eecfe54fb209 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36722025-07-18T00:02:58.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 252f4fd2-03a9-414f-aa32-eecfe54fb209 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36732025-07-18T00:02:59.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b999ee32-adcf-4f53-8657-76694aac7c1c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36742025-07-18T00:02:59.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b999ee32-adcf-4f53-8657-76694aac7c1c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36752025-07-18T00:02:59.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b999ee32-adcf-4f53-8657-76694aac7c1c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
36762025-07-18T00:03:00.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 135 reason = Timeout
36772025-07-18T00:03:00.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
36782025-07-18T00:03:00.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
36792025-07-18T00:03:00.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36802025-07-18T00:03:00.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
36812025-07-18T00:03:00.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
36822025-07-18T00:03:00.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
36832025-07-18T00:03:00.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
36842025-07-18T00:03:00.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
36852025-07-18T00:03:00.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36862025-07-18T00:03:00.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36872025-07-18T00:03:00.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36882025-07-18T00:03:00.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36892025-07-18T00:03:00.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
36902025-07-18T00:03:00.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.716934ms iteration = 135 status = {"chicken_switches_updated":false}
36912025-07-18T00:03:00.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36922025-07-18T00:03:00.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36932025-07-18T00:03:00.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36942025-07-18T00:03:00.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36952025-07-18T00:03:00.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36962025-07-18T00:03:00.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36972025-07-18T00:03:00.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36982025-07-18T00:03:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
36992025-07-18T00:03:00.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37002025-07-18T00:03:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37012025-07-18T00:03:00.241ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
37022025-07-18T00:03:00.241ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.803287ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
37032025-07-18T00:03:00.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37042025-07-18T00:03:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37052025-07-18T00:03:00.251ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.932433ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37062025-07-18T00:03:00.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c7916f3a-60ee-4436-8c5f-5854e56d1624 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37072025-07-18T00:03:00.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c7916f3a-60ee-4436-8c5f-5854e56d1624 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37082025-07-18T00:03:00.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c7916f3a-60ee-4436-8c5f-5854e56d1624 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37092025-07-18T00:03:00.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 626 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 4301c7ad-89b2-4ef9-83e1-ba3b3e641865 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
37102025-07-18T00:03:01.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 820dd717-f721-4009-9f4b-f4009f3664bd roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37112025-07-18T00:03:01.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 820dd717-f721-4009-9f4b-f4009f3664bd resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37122025-07-18T00:03:01.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 820dd717-f721-4009-9f4b-f4009f3664bd response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37132025-07-18T00:03:02.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d2549ce0-790f-48e9-9702-449c4e747a29 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37142025-07-18T00:03:02.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d2549ce0-790f-48e9-9702-449c4e747a29 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37152025-07-18T00:03:02.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d2549ce0-790f-48e9-9702-449c4e747a29 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37162025-07-18T00:03:03.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 38d1c76c-87ca-4766-8ccd-27523b645668 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37172025-07-18T00:03:03.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 38d1c76c-87ca-4766-8ccd-27523b645668 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37182025-07-18T00:03:03.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 38d1c76c-87ca-4766-8ccd-27523b645668 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37192025-07-18T00:03:04.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3417ddf0-694c-479c-9f03-e07b204e4f41 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37202025-07-18T00:03:04.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3417ddf0-694c-479c-9f03-e07b204e4f41 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37212025-07-18T00:03:04.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3417ddf0-694c-479c-9f03-e07b204e4f41 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37222025-07-18T00:03:05.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 136 reason = Timeout
37232025-07-18T00:03:05.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
37242025-07-18T00:03:05.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
37252025-07-18T00:03:05.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37262025-07-18T00:03:05.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
37272025-07-18T00:03:05.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
37282025-07-18T00:03:05.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
37292025-07-18T00:03:05.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
37302025-07-18T00:03:05.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.244112ms iteration = 136 status = {"chicken_switches_updated":false}
37312025-07-18T00:03:05.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b97cd1a7-7759-455a-9838-f813abecdb73 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37322025-07-18T00:03:05.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b97cd1a7-7759-455a-9838-f813abecdb73 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37332025-07-18T00:03:05.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b97cd1a7-7759-455a-9838-f813abecdb73 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37342025-07-18T00:03:06.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48889c58-302b-4b4f-80e2-3ca3f3575041 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37352025-07-18T00:03:06.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48889c58-302b-4b4f-80e2-3ca3f3575041 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37362025-07-18T00:03:06.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48889c58-302b-4b4f-80e2-3ca3f3575041 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37372025-07-18T00:03:07.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5f8fd42b-a17c-4192-b6b9-69f062cef67d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37382025-07-18T00:03:07.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5f8fd42b-a17c-4192-b6b9-69f062cef67d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37392025-07-18T00:03:07.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5f8fd42b-a17c-4192-b6b9-69f062cef67d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37402025-07-18T00:03:08.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = cc0e99b4-6720-4c75-aef0-ff6c2059d5be roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37412025-07-18T00:03:08.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = cc0e99b4-6720-4c75-aef0-ff6c2059d5be resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37422025-07-18T00:03:08.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = cc0e99b4-6720-4c75-aef0-ff6c2059d5be response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37432025-07-18T00:03:09.692ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f64c32b6-6890-4c3e-94cd-b954a3778f0b remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e8da2d2c-356f-4c8c-96ea-6e24f3134c00 uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-07-18T00:03:09.670282011Z }
37442025-07-18T00:03:09.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e8da2d2c-356f-4c8c-96ea-6e24f3134c00 roles = RoleSet { roles: {} } uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
37452025-07-18T00:03:09.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e8da2d2c-356f-4c8c-96ea-6e24f3134c00 resource = Database result = Ok(()) uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
37462025-07-18T00:03:09.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 94460 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e8da2d2c-356f-4c8c-96ea-6e24f3134c00 response_code = 204 uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
37472025-07-18T00:03:09.765ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f64c32b6-6890-4c3e-94cd-b954a3778f0b remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8df9d984-6016-4542-b192-3f28c602accc uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-07-18T00:03:09.765399075Z }
37482025-07-18T00:03:09.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8df9d984-6016-4542-b192-3f28c602accc roles = RoleSet { roles: {} } uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
37492025-07-18T00:03:09.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8df9d984-6016-4542-b192-3f28c602accc resource = Database result = Ok(()) uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
37502025-07-18T00:03:09.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 77754 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8df9d984-6016-4542-b192-3f28c602accc response_code = 204 uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
37512025-07-18T00:03:09.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 74abf9d3-0754-4c8c-9882-35eb078a31ec roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37522025-07-18T00:03:09.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 74abf9d3-0754-4c8c-9882-35eb078a31ec resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37532025-07-18T00:03:09.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 74abf9d3-0754-4c8c-9882-35eb078a31ec response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37542025-07-18T00:03:10.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 137 reason = Timeout
37552025-07-18T00:03:10.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
37562025-07-18T00:03:10.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
37572025-07-18T00:03:10.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37582025-07-18T00:03:10.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
37592025-07-18T00:03:10.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
37602025-07-18T00:03:10.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
37612025-07-18T00:03:10.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
37622025-07-18T00:03:10.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37632025-07-18T00:03:10.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
37642025-07-18T00:03:10.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37652025-07-18T00:03:10.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37662025-07-18T00:03:10.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37672025-07-18T00:03:10.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
37682025-07-18T00:03:10.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.1339ms iteration = 137 status = {"chicken_switches_updated":false}
37692025-07-18T00:03:10.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37702025-07-18T00:03:10.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37712025-07-18T00:03:10.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37722025-07-18T00:03:10.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37732025-07-18T00:03:10.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37742025-07-18T00:03:10.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37752025-07-18T00:03:10.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37762025-07-18T00:03:10.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
37772025-07-18T00:03:10.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37782025-07-18T00:03:10.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37792025-07-18T00:03:10.239ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
37802025-07-18T00:03:10.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.457011ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
37812025-07-18T00:03:10.252ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37822025-07-18T00:03:10.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37832025-07-18T00:03:10.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.116027ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37842025-07-18T00:03:10.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 86f1507d-4398-4d5f-a329-2312ec9dd77a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37852025-07-18T00:03:10.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 86f1507d-4398-4d5f-a329-2312ec9dd77a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37862025-07-18T00:03:10.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1781 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 86f1507d-4398-4d5f-a329-2312ec9dd77a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37872025-07-18T00:03:10.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 659 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 5989c747-e6be-4875-8fca-8b74232602a1 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
37882025-07-18T00:03:11.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9f1e5788-fae2-42ff-96eb-7cf0a504a7c4 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37892025-07-18T00:03:11.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9f1e5788-fae2-42ff-96eb-7cf0a504a7c4 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37902025-07-18T00:03:11.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9f1e5788-fae2-42ff-96eb-7cf0a504a7c4 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37912025-07-18T00:03:12.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1397f2f3-f7fc-438c-b141-98f860968f5d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37922025-07-18T00:03:12.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1397f2f3-f7fc-438c-b141-98f860968f5d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37932025-07-18T00:03:12.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1397f2f3-f7fc-438c-b141-98f860968f5d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37942025-07-18T00:03:13.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c8ddf4ba-d0fb-4007-ab3d-50073ee4bf4b roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37952025-07-18T00:03:13.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c8ddf4ba-d0fb-4007-ab3d-50073ee4bf4b resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37962025-07-18T00:03:13.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c8ddf4ba-d0fb-4007-ab3d-50073ee4bf4b response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37972025-07-18T00:03:15.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c8cc8d42-1b09-4072-9853-f5002b38ca4c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37982025-07-18T00:03:15.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c8cc8d42-1b09-4072-9853-f5002b38ca4c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
37992025-07-18T00:03:15.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c8cc8d42-1b09-4072-9853-f5002b38ca4c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38002025-07-18T00:03:15.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 138 reason = Timeout
38012025-07-18T00:03:15.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
38022025-07-18T00:03:15.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
38032025-07-18T00:03:15.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38042025-07-18T00:03:15.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
38052025-07-18T00:03:15.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
38062025-07-18T00:03:15.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
38072025-07-18T00:03:15.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
38082025-07-18T00:03:15.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.14078ms iteration = 138 status = {"chicken_switches_updated":false}
38092025-07-18T00:03:16.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3147d6eb-9b20-4562-b033-0a783082ad3a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38102025-07-18T00:03:16.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3147d6eb-9b20-4562-b033-0a783082ad3a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38112025-07-18T00:03:16.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3147d6eb-9b20-4562-b033-0a783082ad3a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38122025-07-18T00:03:17.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f2ad5833-6e3c-44a6-9640-d87fa0a51291 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38132025-07-18T00:03:17.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f2ad5833-6e3c-44a6-9640-d87fa0a51291 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38142025-07-18T00:03:17.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f2ad5833-6e3c-44a6-9640-d87fa0a51291 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38152025-07-18T00:03:18.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a91fb9ac-3b3e-4f29-87f5-171711061fd6 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38162025-07-18T00:03:18.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a91fb9ac-3b3e-4f29-87f5-171711061fd6 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38172025-07-18T00:03:18.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a91fb9ac-3b3e-4f29-87f5-171711061fd6 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38182025-07-18T00:03:19.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7bdc6df7-8af0-4f70-9c76-91dcffade161 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38192025-07-18T00:03:19.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7bdc6df7-8af0-4f70-9c76-91dcffade161 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38202025-07-18T00:03:19.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7bdc6df7-8af0-4f70-9c76-91dcffade161 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38212025-07-18T00:03:20.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bc34e541-9119-4dd7-b640-31bff1534bac roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38222025-07-18T00:03:20.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bc34e541-9119-4dd7-b640-31bff1534bac resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38232025-07-18T00:03:20.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bc34e541-9119-4dd7-b640-31bff1534bac response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
38242025-07-18T00:03:20.207ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
38252025-07-18T00:03:20.207ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
38262025-07-18T00:03:20.207ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38272025-07-18T00:03:20.207ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
38282025-07-18T00:03:20.207ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38292025-07-18T00:03:20.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38302025-07-18T00:03:20.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38312025-07-18T00:03:20.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 139 reason = Timeout
38322025-07-18T00:03:20.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
38332025-07-18T00:03:20.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
38342025-07-18T00:03:20.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 287667413 } })
38352025-07-18T00:03:20.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
38362025-07-18T00:03:20.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 288707100 } })
38372025-07-18T00:03:20.211ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.651136ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38382025-07-18T00:03:20.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
38392025-07-18T00:03:20.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38402025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
38412025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
38422025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38432025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38442025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
38452025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
38462025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38472025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
38482025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38492025-07-18T00:03:20.216ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38502025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38512025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
38522025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
38532025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38542025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38552025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
38562025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38572025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
38582025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
38592025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38602025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38612025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
38622025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38632025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38642025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38652025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38662025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38672025-07-18T00:03:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38682025-07-18T00:03:20.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38692025-07-18T00:03:20.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38702025-07-18T00:03:20.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38712025-07-18T00:03:20.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38722025-07-18T00:03:20.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38732025-07-18T00:03:20.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38742025-07-18T00:03:20.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38752025-07-18T00:03:20.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
38762025-07-18T00:03:20.217ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
38772025-07-18T00:03:20.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
38782025-07-18T00:03:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
38792025-07-18T00:03:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38802025-07-18T00:03:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
38812025-07-18T00:03:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38822025-07-18T00:03:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
38832025-07-18T00:03:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38842025-07-18T00:03:20.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38852025-07-18T00:03:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38862025-07-18T00:03:20.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
38872025-07-18T00:03:20.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38882025-07-18T00:03:20.219ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 24 reason = Timeout
38892025-07-18T00:03:20.219ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
38902025-07-18T00:03:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38912025-07-18T00:03:20.219ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
38922025-07-18T00:03:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38932025-07-18T00:03:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
38942025-07-18T00:03:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38952025-07-18T00:03:20.219ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 297448404 } })
38962025-07-18T00:03:20.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38972025-07-18T00:03:20.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38982025-07-18T00:03:20.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38992025-07-18T00:03:20.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39002025-07-18T00:03:20.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39012025-07-18T00:03:20.223ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39022025-07-18T00:03:20.223ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39032025-07-18T00:03:20.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39042025-07-18T00:03:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39052025-07-18T00:03:20.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39062025-07-18T00:03:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39072025-07-18T00:03:20.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39082025-07-18T00:03:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39092025-07-18T00:03:20.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39102025-07-18T00:03:20.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39112025-07-18T00:03:20.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39122025-07-18T00:03:20.226ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39132025-07-18T00:03:20.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
39142025-07-18T00:03:20.227ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39152025-07-18T00:03:20.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39162025-07-18T00:03:20.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39172025-07-18T00:03:20.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39182025-07-18T00:03:20.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39192025-07-18T00:03:20.228ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39202025-07-18T00:03:20.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39212025-07-18T00:03:20.228ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39222025-07-18T00:03:20.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39232025-07-18T00:03:20.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39242025-07-18T00:03:20.230ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39252025-07-18T00:03:20.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39262025-07-18T00:03:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39272025-07-18T00:03:20.231ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39282025-07-18T00:03:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39292025-07-18T00:03:20.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.218104ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
39302025-07-18T00:03:20.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39312025-07-18T00:03:20.235ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
39322025-07-18T00:03:20.235ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 25.908799ms iteration = 139 status = {"chicken_switches_updated":false}
39332025-07-18T00:03:20.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.606435ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
39342025-07-18T00:03:20.235ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 16.603926ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
39352025-07-18T00:03:20.236ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39362025-07-18T00:03:20.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39372025-07-18T00:03:20.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39382025-07-18T00:03:20.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.971523ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39392025-07-18T00:03:20.237ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 315189277 } })
39402025-07-18T00:03:20.237ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
39412025-07-18T00:03:20.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 22.708379ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39422025-07-18T00:03:20.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39432025-07-18T00:03:20.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39442025-07-18T00:03:20.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39452025-07-18T00:03:20.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39462025-07-18T00:03:20.252ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39472025-07-18T00:03:20.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39482025-07-18T00:03:20.253ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39492025-07-18T00:03:20.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39502025-07-18T00:03:20.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39512025-07-18T00:03:20.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39522025-07-18T00:03:20.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39532025-07-18T00:03:20.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
39542025-07-18T00:03:20.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39552025-07-18T00:03:20.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39562025-07-18T00:03:20.272ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39572025-07-18T00:03:20.272ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39582025-07-18T00:03:20.272ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39592025-07-18T00:03:20.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39602025-07-18T00:03:20.273ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
39612025-07-18T00:03:20.273ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.064038ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
39622025-07-18T00:03:20.276ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39632025-07-18T00:03:20.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39642025-07-18T00:03:20.293ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39652025-07-18T00:03:20.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39662025-07-18T00:03:20.293ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 74.997295ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
39672025-07-18T00:03:20.295ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39682025-07-18T00:03:20.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39692025-07-18T00:03:20.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39702025-07-18T00:03:20.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39712025-07-18T00:03:20.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, lookup_type: ById(4a597d98-bd6a-42be-a09e-71b1fbba6de5) } result = Ok(())
39722025-07-18T00:03:20.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39732025-07-18T00:03:20.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39742025-07-18T00:03:20.311ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.119205ms iteration = 24 status = 0
39752025-07-18T00:03:20.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39762025-07-18T00:03:20.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39772025-07-18T00:03:20.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39782025-07-18T00:03:20.316ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39792025-07-18T00:03:20.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
39802025-07-18T00:03:20.319ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39812025-07-18T00:03:20.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39822025-07-18T00:03:20.326ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
39832025-07-18T00:03:20.326ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39842025-07-18T00:03:20.326ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "60ac5c4a-72bd-424f-aada-7595df533c6c", "content-length": "26", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
39852025-07-18T00:03:20.326ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39862025-07-18T00:03:20.328ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39872025-07-18T00:03:20.328ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
39882025-07-18T00:03:20.328ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39892025-07-18T00:03:20.329ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e244859-f858-4335-b6cd-2f4fa8b251f9", "content-length": "26", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
39902025-07-18T00:03:20.329ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39912025-07-18T00:03:20.330ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39922025-07-18T00:03:20.333ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39932025-07-18T00:03:20.333ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39942025-07-18T00:03:20.333ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39952025-07-18T00:03:20.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39962025-07-18T00:03:20.337ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 118.836749ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39972025-07-18T00:03:20.345ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
39982025-07-18T00:03:20.345ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "794c3b09-9eba-4f7e-af9d-826213080535", "content-length": "78", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
39992025-07-18T00:03:20.345ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
40002025-07-18T00:03:20.345ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
40012025-07-18T00:03:20.345ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
40022025-07-18T00:03:20.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
40032025-07-18T00:03:20.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
40042025-07-18T00:03:20.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
40052025-07-18T00:03:20.347ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
40062025-07-18T00:03:20.348ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
40072025-07-18T00:03:20.349ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
40082025-07-18T00:03:20.350ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
40092025-07-18T00:03:20.350ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
40102025-07-18T00:03:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
40112025-07-18T00:03:20.351ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
40122025-07-18T00:03:20.351ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
40132025-07-18T00:03:20.352ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
40142025-07-18T00:03:20.352ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
40152025-07-18T00:03:20.352ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
40162025-07-18T00:03:20.352ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
40172025-07-18T00:03:20.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
40182025-07-18T00:03:20.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
40192025-07-18T00:03:20.352ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8e008cb-c92d-42a9-a0ab-f760bc65e931", "content-length": "81", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
40202025-07-18T00:03:20.353ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
40212025-07-18T00:03:20.353ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
40222025-07-18T00:03:20.354ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "17db971e-a506-4d73-bb11-d9f26029c3e6", "content-length": "81", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
40232025-07-18T00:03:20.374ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 158.404278ms iteration = 27 status = {"physical_disks_added":0}
40242025-07-18T00:03:20.379ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:389
40252025-07-18T00:03:20.379ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 163.04211ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
40262025-07-18T00:03:20.382ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40272025-07-18T00:03:20.382ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40282025-07-18T00:03:20.382ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 166.404912ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40292025-07-18T00:03:20.390ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 zone_address = fd00:1122:3344:101::2
40302025-07-18T00:03:20.390ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40312025-07-18T00:03:20.391ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2400bb31-d6fa-4ade-bcce-c7814153cec3", "content-length": "26", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
40322025-07-18T00:03:20.391ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40332025-07-18T00:03:20.393ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
40342025-07-18T00:03:20.401ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40352025-07-18T00:03:20.401ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40362025-07-18T00:03:20.402ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9a46928-8732-4b26-b13e-e8ed11dce4d0", "content-length": "583", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
40372025-07-18T00:03:20.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40382025-07-18T00:03:20.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40392025-07-18T00:03:20.405ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
40402025-07-18T00:03:20.405ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
40412025-07-18T00:03:20.405ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf41e451-e036-4bf6-834c-1aa477ecceb2", "content-length": "81", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
40422025-07-18T00:03:20.408ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 188.695445ms iteration = 24 status = {"errors":[],"sps":[]}
40432025-07-18T00:03:20.409ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40442025-07-18T00:03:20.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40452025-07-18T00:03:20.420ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40462025-07-18T00:03:20.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40472025-07-18T00:03:20.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40482025-07-18T00:03:20.424ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40492025-07-18T00:03:20.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40502025-07-18T00:03:20.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40512025-07-18T00:03:20.426ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40522025-07-18T00:03:20.430ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40532025-07-18T00:03:20.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40542025-07-18T00:03:20.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40552025-07-18T00:03:20.466ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {8795b04b-3a00-4cbb-a2e9-10b29de29924: {10.151.2.176: {e8d99606-cb14-479a-8fbd-52c17be7a1bb}, 10.151.2.175: {e8d99606-cb14-479a-8fbd-52c17be7a1bb}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
40562025-07-18T00:03:20.467ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40572025-07-18T00:03:20.467ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6162a890-5c7d-4309-a5db-7d6d09098371", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
40582025-07-18T00:03:20.467ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40592025-07-18T00:03:20.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40602025-07-18T00:03:20.468ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b/state
40612025-07-18T00:03:20.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40622025-07-18T00:03:20.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40632025-07-18T00:03:20.472ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e3a5b3f-7d85-4869-9e1c-1e0882a8f8f8", "content-length": "130", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
40642025-07-18T00:03:20.472ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 sled_id = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-07-18T00:03:09.765399075Z }, migration_in: None, migration_out: None } vmm_id = f64c32b6-6890-4c3e-94cd-b954a3778f0b
40652025-07-18T00:03:20.472ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2140 instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f64c32b6-6890-4c3e-94cd-b954a3778f0b sled_id = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 vmm_id = f64c32b6-6890-4c3e-94cd-b954a3778f0b vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-07-18T00:03:09.765399075Z }
40662025-07-18T00:03:20.472ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 roles = RoleSet { roles: {} } sled_id = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 vmm_id = f64c32b6-6890-4c3e-94cd-b954a3778f0b
40672025-07-18T00:03:20.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 resource = Database result = Ok(()) sled_id = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 vmm_id = f64c32b6-6890-4c3e-94cd-b954a3778f0b
40682025-07-18T00:03:20.473ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40692025-07-18T00:03:20.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40702025-07-18T00:03:20.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40712025-07-18T00:03:20.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40722025-07-18T00:03:20.482ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
40732025-07-18T00:03:20.483ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40742025-07-18T00:03:20.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40752025-07-18T00:03:20.485ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 268.995861ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
40762025-07-18T00:03:20.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40772025-07-18T00:03:20.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40782025-07-18T00:03:20.490ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40792025-07-18T00:03:20.490ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40802025-07-18T00:03:20.490ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40812025-07-18T00:03:20.490ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e33f7eee-8b46-410e-a05b-983367d6edb5", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
40822025-07-18T00:03:20.493ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 276.680099ms iteration = 24 status = {}
40832025-07-18T00:03:20.562ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40842025-07-18T00:03:20.562ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "22c78e41-95cb-494a-a4b8-eb3756ba5cf7", "content-length": "810", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
40852025-07-18T00:03:20.562ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(8843700) }} sled = sock
40862025-07-18T00:03:20.562ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
40872025-07-18T00:03:20.562ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
40882025-07-18T00:03:20.564ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 348.333953ms iteration = 24 status = {}
40892025-07-18T00:03:20.575ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 367.65663ms iteration = 24 status = {}
40902025-07-18T00:03:20.579ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40912025-07-18T00:03:20.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40922025-07-18T00:03:20.581ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 374.169111ms iteration = 24 status = null
40932025-07-18T00:03:20.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40942025-07-18T00:03:20.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40952025-07-18T00:03:20.632ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a2d734dc-e0c9-4fd6-b442-f2c4e63791e5, rack_id: e4e73d6b-d53c-414c-93a8-eff1ed3c4807, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(9d790dba-5335-4b4c-be2a-58416dc1e8f5) } rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
40962025-07-18T00:03:20.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40972025-07-18T00:03:20.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40982025-07-18T00:03:20.644ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
40992025-07-18T00:03:20.644ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 9d790dba-5335-4b4c-be2a-58416dc1e8f5
41002025-07-18T00:03:20.645ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41012025-07-18T00:03:20.645ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41022025-07-18T00:03:20.645ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41032025-07-18T00:03:20.645ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41042025-07-18T00:03:20.645ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41052025-07-18T00:03:20.645ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41062025-07-18T00:03:20.645ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41072025-07-18T00:03:20.645ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41082025-07-18T00:03:20.645ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
41092025-07-18T00:03:20.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41102025-07-18T00:03:20.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41112025-07-18T00:03:20.648ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
41122025-07-18T00:03:20.648ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41132025-07-18T00:03:20.820ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "514d794a-f189-47d7-b5f8-d6462e1666bc", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
41142025-07-18T00:03:20.820ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch = Switch0
41152025-07-18T00:03:20.820ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41162025-07-18T00:03:20.821ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "76ac550a-b83d-42c8-84fe-c7501265d760", "content-length": "682", "date": "Fri, 18 Jul 2025 00:03:20 GMT"} })
41172025-07-18T00:03:20.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41182025-07-18T00:03:20.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41192025-07-18T00:03:20.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41202025-07-18T00:03:20.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41212025-07-18T00:03:20.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41222025-07-18T00:03:20.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41232025-07-18T00:03:20.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41242025-07-18T00:03:20.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41252025-07-18T00:03:20.840ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 623.654102ms iteration = 24 status = {}
41262025-07-18T00:03:20.964ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:65108
41272025-07-18T00:03:20.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65108 req_id = 86ebac45-0fa8-472f-b495-db81c9937378 roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
41282025-07-18T00:03:20.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65108 req_id = 86ebac45-0fa8-472f-b495-db81c9937378 resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
41292025-07-18T00:03:20.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65108 req_id = 86ebac45-0fa8-472f-b495-db81c9937378 response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
41302025-07-18T00:03:20.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65108 req_id = 3e00feda-b320-48cb-9a89-018e1454f236 roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
41312025-07-18T00:03:20.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65108 req_id = 3e00feda-b320-48cb-9a89-018e1454f236 resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
41322025-07-18T00:03:20.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:65108 req_id = 3e00feda-b320-48cb-9a89-018e1454f236 response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
41332025-07-18T00:03:20.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4216 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = c0f5e901-2247-4b65-b334-8bcbe3073d85 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
41342025-07-18T00:03:21.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3a8031fb-4551-4d5c-99df-aeed3c453d2f roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41352025-07-18T00:03:21.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3a8031fb-4551-4d5c-99df-aeed3c453d2f resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41362025-07-18T00:03:21.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3a8031fb-4551-4d5c-99df-aeed3c453d2f response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41372025-07-18T00:03:22.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 651111d7-c37a-4ee6-b8df-e0fa2fc8f141 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41382025-07-18T00:03:22.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 651111d7-c37a-4ee6-b8df-e0fa2fc8f141 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41392025-07-18T00:03:22.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 651111d7-c37a-4ee6-b8df-e0fa2fc8f141 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41402025-07-18T00:03:23.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b7c1c88c-3aca-4807-b060-68de2c547963 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41412025-07-18T00:03:23.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b7c1c88c-3aca-4807-b060-68de2c547963 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41422025-07-18T00:03:23.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b7c1c88c-3aca-4807-b060-68de2c547963 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41432025-07-18T00:03:23.291ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f64c32b6-6890-4c3e-94cd-b954a3778f0b remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48d72d38-e03d-4d0a-a8ed-cda90efe764f uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-07-18T00:03:23.291233622Z }
41442025-07-18T00:03:23.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48d72d38-e03d-4d0a-a8ed-cda90efe764f roles = RoleSet { roles: {} } uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41452025-07-18T00:03:23.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48d72d38-e03d-4d0a-a8ed-cda90efe764f resource = Database result = Ok(()) uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41462025-07-18T00:03:23.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 13665 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48d72d38-e03d-4d0a-a8ed-cda90efe764f response_code = 204 uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41472025-07-18T00:03:24.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 963a6499-efc7-46bb-acdc-1596beb35fd7 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41482025-07-18T00:03:24.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 963a6499-efc7-46bb-acdc-1596beb35fd7 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41492025-07-18T00:03:24.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 963a6499-efc7-46bb-acdc-1596beb35fd7 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41502025-07-18T00:03:25.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 014333da-22f4-4ddb-ac7f-cc26561deffc roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41512025-07-18T00:03:25.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 014333da-22f4-4ddb-ac7f-cc26561deffc resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41522025-07-18T00:03:25.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 014333da-22f4-4ddb-ac7f-cc26561deffc response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
41532025-07-18T00:03:25.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 140 reason = Timeout
41542025-07-18T00:03:25.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
41552025-07-18T00:03:25.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
41562025-07-18T00:03:25.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41572025-07-18T00:03:25.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
41582025-07-18T00:03:25.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
41592025-07-18T00:03:25.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
41602025-07-18T00:03:25.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
41612025-07-18T00:03:25.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.221471ms iteration = 140 status = {"chicken_switches_updated":false}
41622025-07-18T00:03:25.743ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f64c32b6-6890-4c3e-94cd-b954a3778f0b remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-07-18T00:03:23.305465462Z }
41632025-07-18T00:03:25.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 roles = RoleSet { roles: {} } uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41642025-07-18T00:03:25.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 resource = Database result = Ok(()) uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41652025-07-18T00:03:25.759ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = f64c32b6-6890-4c3e-94cd-b954a3778f0b remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b vmm_needs_update = true
41662025-07-18T00:03:25.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 roles = RoleSet { roles: {} } uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41672025-07-18T00:03:25.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 resource = Database result = Ok(()) uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41682025-07-18T00:03:25.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 roles = RoleSet { roles: {} } uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41692025-07-18T00:03:25.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 resource = Database result = Ok(()) uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41702025-07-18T00:03:25.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 roles = RoleSet { roles: {} } uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41712025-07-18T00:03:25.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 resource = Database result = Ok(()) uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41722025-07-18T00:03:25.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 roles = RoleSet { roles: {} } uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41732025-07-18T00:03:25.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 resource = Database result = Ok(()) uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41742025-07-18T00:03:25.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 roles = RoleSet { roles: {} } uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41752025-07-18T00:03:25.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 resource = Database result = Ok(()) uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41762025-07-18T00:03:25.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 roles = RoleSet { roles: {} } uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41772025-07-18T00:03:25.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 resource = Database result = Ok(()) uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41782025-07-18T00:03:25.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41792025-07-18T00:03:25.776ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f37123ec-61ff-4793-867b-6920b7f6246a, lookup_type: ById(f37123ec-61ff-4793-867b-6920b7f6246a) }, key: 94db2073-cec5-48dd-b6b6-28c3e6fabb6e, lookup_type: ById(94db2073-cec5-48dd-b6b6-28c3e6fabb6e) }, key: 906e16ea-5647-4bb1-87e3-adc1b6425e89, lookup_type: ById(906e16ea-5647-4bb1-87e3-adc1b6425e89) } result = Ok(()) uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41802025-07-18T00:03:25.791ZINFOnexus (dropshot_internal): starting update saga for 906e16ea-5647-4bb1-87e3-adc1b6425e89 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1603 instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-07-18T00:03:23.305465462Z }
41812025-07-18T00:03:25.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 48582 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 response_code = 204 uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41822025-07-18T00:03:25.794ZDEBGnexus (dropshot_internal): preparing instance-update saga for 906e16ea-5647-4bb1-87e3-adc1b6425e89... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 6bf5b8c4-a822-4080-9852-1e7de79f10e8 uri = /vmms/f64c32b6-6890-4c3e-94cd-b954a3778f0b
41832025-07-18T00:03:25.794ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update
41842025-07-18T00:03:25.794ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"906e16ea-5647-4bb1-87e3-adc1b6425e89","lookup_type":{"ById":"906e16ea-5647-4bb1-87e3-adc1b6425e89"},"parent":{"key":"94db2073-cec5-48dd-b6b6-28c3e6fabb6e","lookup_type":{"ById":"94db2073-cec5-48dd-b6b6-28c3e6fabb6e"},"parent":{"key":"f37123ec-61ff-4793-867b-6920b7f6246a","lookup_type":{"ById":"f37123ec-61ff-4793-867b-6920b7f6246a"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
41852025-07-18T00:03:25.794ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update
41862025-07-18T00:03:25.806ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update
41872025-07-18T00:03:25.806ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
41882025-07-18T00:03:25.809ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
41892025-07-18T00:03:25.809ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d
41902025-07-18T00:03:25.823ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
41912025-07-18T00:03:25.823ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d
41922025-07-18T00:03:25.832ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
41932025-07-18T00:03:25.832ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d
41942025-07-18T00:03:25.842ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
41952025-07-18T00:03:25.842ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("5d34f74c-8209-4a7e-99c6-7c2b155135ab")) node_id = 0 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d
41962025-07-18T00:03:25.848ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
41972025-07-18T00:03:25.848ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d
41982025-07-18T00:03:25.869ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update
41992025-07-18T00:03:25.869ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42002025-07-18T00:03:25.869ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42012025-07-18T00:03:25.871ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42022025-07-18T00:03:25.872ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42032025-07-18T00:03:25.873ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42042025-07-18T00:03:25.874ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42052025-07-18T00:03:25.878ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42062025-07-18T00:03:25.878ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42072025-07-18T00:03:25.880ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42082025-07-18T00:03:25.880ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42092025-07-18T00:03:25.881ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42102025-07-18T00:03:25.881ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42112025-07-18T00:03:25.883ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42122025-07-18T00:03:25.886ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f37123ec-61ff-4793-867b-6920b7f6246a, lookup_type: ById(f37123ec-61ff-4793-867b-6920b7f6246a) }, key: 94db2073-cec5-48dd-b6b6-28c3e6fabb6e, lookup_type: ById(94db2073-cec5-48dd-b6b6-28c3e6fabb6e) }, key: 906e16ea-5647-4bb1-87e3-adc1b6425e89, lookup_type: ById(906e16ea-5647-4bb1-87e3-adc1b6425e89) } result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42132025-07-18T00:03:25.886ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance updater_id = 5d34f74c-8209-4a7e-99c6-7c2b155135ab
42142025-07-18T00:03:25.886ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42152025-07-18T00:03:25.886ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42162025-07-18T00:03:25.906ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance updater_id = 5d34f74c-8209-4a7e-99c6-7c2b155135ab
42172025-07-18T00:03:25.906ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42182025-07-18T00:03:25.906ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance
42192025-07-18T00:03:25.911ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 locked_gen = Generation(Generation(2)) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = LockInstance updater_id = 5d34f74c-8209-4a7e-99c6-7c2b155135ab
42202025-07-18T00:03:25.913ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42212025-07-18T00:03:25.913ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("5d34f74c-8209-4a7e-99c6-7c2b155135ab")}) node_id = 1 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d
42222025-07-18T00:03:25.919ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42232025-07-18T00:03:25.919ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d
42242025-07-18T00:03:25.927ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
42252025-07-18T00:03:25.927ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
42262025-07-18T00:03:25.929ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
42272025-07-18T00:03:25.929ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
42282025-07-18T00:03:25.930ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
42292025-07-18T00:03:25.930ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
42302025-07-18T00:03:25.932ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
42312025-07-18T00:03:25.935ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f37123ec-61ff-4793-867b-6920b7f6246a, lookup_type: ById(f37123ec-61ff-4793-867b-6920b7f6246a) }, key: 94db2073-cec5-48dd-b6b6-28c3e6fabb6e, lookup_type: ById(94db2073-cec5-48dd-b6b6-28c3e6fabb6e) }, key: 906e16ea-5647-4bb1-87e3-adc1b6425e89, lookup_type: ById(906e16ea-5647-4bb1-87e3-adc1b6425e89) } result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
42322025-07-18T00:03:25.935ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
42332025-07-18T00:03:25.935ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
42342025-07-18T00:03:25.941ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: f64c32b6-6890-4c3e-94cd-b954a3778f0b, time_created: 2025-07-18T00:02:59.689862Z, time_deleted: None, instance_id: 906e16ea-5647-4bb1-87e3-adc1b6425e89, sled_id: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-07-18T00:03:23.305465Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-07-18T00:02:57.538710Z, gen: Generation(Generation(3)), propolis_id: Some(f64c32b6-6890-4c3e-94cd-b954a3778f0b), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(f64c32b6-6890-4c3e-94cd-b954a3778f0b (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-07-18T00:03:25.941120516Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
42352025-07-18T00:03:25.943ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
42362025-07-18T00:03:25.943ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"906e16ea-5647-4bb1-87e3-adc1b6425e89","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"f64c32b6-6890-4c3e-94cd-b954a3778f0b"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"906e16ea-5647-4bb1-87e3-adc1b6425e89","lookup_type":{"ById":"906e16ea-5647-4bb1-87e3-adc1b6425e89"},"parent":{"key":"94db2073-cec5-48dd-b6b6-28c3e6fabb6e","lookup_type":{"ById":"94db2073-cec5-48dd-b6b6-28c3e6fabb6e"},"parent":{"key":"f37123ec-61ff-4793-867b-6920b7f6246a","lookup_type":{"ById":"f37123ec-61ff-4793-867b-6920b7f6246a"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"5d34f74c-8209-4a7e-99c6-7c2b155135ab"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"94db2073-cec5-48dd-b6b6-28c3e6fabb6e","ram_diff":1073741824},"destroy_active_vmm":"f64c32b6-6890-4c3e-94cd-b954a3778f0b","destroy_target_vmm":null,"network_config":"Delete","new_intent":null,"new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-07-18T00:03:25.941120516Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42372025-07-18T00:03:25.943ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
42382025-07-18T00:03:25.951ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
42392025-07-18T00:03:25.951ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42402025-07-18T00:03:25.951ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42412025-07-18T00:03:25.951ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
42422025-07-18T00:03:25.955ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42432025-07-18T00:03:25.955ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
42442025-07-18T00:03:25.963ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42452025-07-18T00:03:25.963ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
42462025-07-18T00:03:25.969ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42472025-07-18T00:03:25.969ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("33aaacfc-9f15-4b0d-b7af-325e2fe5735d")) node_id = 0 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
42482025-07-18T00:03:25.973ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42492025-07-18T00:03:25.973ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
42502025-07-18T00:03:25.985ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 parent_lock = UpdaterLock { updater_id: 5d34f74c-8209-4a7e-99c6-7c2b155135ab, locked_gen: Generation(Generation(2)) } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
42512025-07-18T00:03:25.985ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = BecomeUpdater
42522025-07-18T00:03:25.985ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = BecomeUpdater
42532025-07-18T00:03:26.012ZDEBGnexus (SagaExecutor): inherited lock from 5d34f74c-8209-4a7e-99c6-7c2b155135ab to 33aaacfc-9f15-4b0d-b7af-325e2fe5735d actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 5d34f74c-8209-4a7e-99c6-7c2b155135ab saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = BecomeUpdater updater_id = 33aaacfc-9f15-4b0d-b7af-325e2fe5735d
42542025-07-18T00:03:26.012ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:987 instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
42552025-07-18T00:03:26.012ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42562025-07-18T00:03:26.012ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("33aaacfc-9f15-4b0d-b7af-325e2fe5735d")}) node_id = 1 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
42572025-07-18T00:03:26.021ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42582025-07-18T00:03:26.021ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
42592025-07-18T00:03:26.034ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42602025-07-18T00:03:26.034ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
42612025-07-18T00:03:26.042ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42622025-07-18T00:03:26.042ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
42632025-07-18T00:03:26.053ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1040 instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
42642025-07-18T00:03:26.053ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89
42652025-07-18T00:03:26.056ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = UpdateNetworkConfig
42662025-07-18T00:03:26.056ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = UpdateNetworkConfig
42672025-07-18T00:03:26.061ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = UpdateNetworkConfig
42682025-07-18T00:03:26.061ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = UpdateNetworkConfig
42692025-07-18T00:03:26.064ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
42702025-07-18T00:03:26.064ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = UpdateNetworkConfig
42712025-07-18T00:03:26.064ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = UpdateNetworkConfig
42722025-07-18T00:03:26.066ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
42732025-07-18T00:03:26.066ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
42742025-07-18T00:03:26.066ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
42752025-07-18T00:03:26.068ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
42762025-07-18T00:03:26.069ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
42772025-07-18T00:03:26.069ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
42782025-07-18T00:03:26.069ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
42792025-07-18T00:03:26.084ZDEBGnexus: notifying dendrite of updates instance_id = Some(906e16ea-5647-4bb1-87e3-adc1b6425e89 (instance)) switch = switch0
42802025-07-18T00:03:26.084ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1689, tv_nsec: 162084201 } })
42812025-07-18T00:03:26.085ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1186
42822025-07-18T00:03:26.115ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
42832025-07-18T00:03:26.115ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42842025-07-18T00:03:26.115ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0908faa7-e6de-46b3-9723-552b2d3b9590", "content-length": "26", "date": "Fri, 18 Jul 2025 00:03:26 GMT"} })
42852025-07-18T00:03:26.115ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42862025-07-18T00:03:26.116ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42872025-07-18T00:03:26.146ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42882025-07-18T00:03:26.146ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
42892025-07-18T00:03:26.153ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42902025-07-18T00:03:26.153ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
42912025-07-18T00:03:26.164ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
42922025-07-18T00:03:26.164ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
42932025-07-18T00:03:26.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 73ddf030-3348-4b8b-a1c6-bcb3beaa77a8 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
42942025-07-18T00:03:26.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 73ddf030-3348-4b8b-a1c6-bcb3beaa77a8 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
42952025-07-18T00:03:26.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 73ddf030-3348-4b8b-a1c6-bcb3beaa77a8 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
42962025-07-18T00:03:26.288ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1115 instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-07-18T00:03:26.165741Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 94db2073-cec5-48dd-b6b6-28c3e6fabb6e, time_modified: Some(2025-07-18T00:03:26.165741Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: f37123ec-61ff-4793-867b-6920b7f6246a, time_modified: Some(2025-07-18T00:03:26.165741Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
42972025-07-18T00:03:26.288ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
42982025-07-18T00:03:26.288ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
42992025-07-18T00:03:26.299ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43002025-07-18T00:03:26.299ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43012025-07-18T00:03:26.310ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1150 instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
43022025-07-18T00:03:26.310ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = UnassignOximeterProducer
43032025-07-18T00:03:26.311ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = UnassignOximeterProducer
43042025-07-18T00:03:26.319ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 13431648-c0eb-4fbe-bcca-ada1fdea1060 producer_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
43052025-07-18T00:03:26.319ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = UnassignOximeterProducer
43062025-07-18T00:03:26.319ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = UnassignOximeterProducer
43072025-07-18T00:03:26.357ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
43082025-07-18T00:03:26.357ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 906e16ea-5647-4bb1-87e3-adc1b6425e89 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/906e16ea-5647-4bb1-87e3-adc1b6425e89
43092025-07-18T00:03:26.392ZDEBGnexus (SagaExecutor): client response oximeter-collector = 906e16ea-5647-4bb1-87e3-adc1b6425e89 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/906e16ea-5647-4bb1-87e3-adc1b6425e89", status: 204, headers: {"x-request-id": "d422f176-4c68-4f47-8599-fe95d6855849", "date": "Fri, 18 Jul 2025 00:03:26 GMT"} }) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
43102025-07-18T00:03:26.392ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 13431648-c0eb-4fbe-bcca-ada1fdea1060 producer_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
43112025-07-18T00:03:26.394ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43122025-07-18T00:03:26.394ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43132025-07-18T00:03:26.415ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43142025-07-18T00:03:26.415ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43152025-07-18T00:03:26.424ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 lock = UpdaterLock { updater_id: 33aaacfc-9f15-4b0d-b7af-325e2fe5735d, locked_gen: Generation(Generation(3)) } new_intent = None new_runtime = InstanceRuntimeState { time_updated: 2025-07-18T00:03:25.941120516Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
43162025-07-18T00:03:26.424ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = CommitInstanceUpdates
43172025-07-18T00:03:26.424ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = CommitInstanceUpdates
43182025-07-18T00:03:26.487ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1201 instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 new_runtime = InstanceRuntimeState { time_updated: 2025-07-18T00:03:25.941120516Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
43192025-07-18T00:03:26.487ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
43202025-07-18T00:03:26.487ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
43212025-07-18T00:03:26.487ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43222025-07-18T00:03:26.487ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43232025-07-18T00:03:26.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43242025-07-18T00:03:26.487ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43252025-07-18T00:03:26.487ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43262025-07-18T00:03:26.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43272025-07-18T00:03:26.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43282025-07-18T00:03:26.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43292025-07-18T00:03:26.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43302025-07-18T00:03:26.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43312025-07-18T00:03:26.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43322025-07-18T00:03:26.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43332025-07-18T00:03:26.496ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43342025-07-18T00:03:26.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43352025-07-18T00:03:26.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43362025-07-18T00:03:26.500ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43372025-07-18T00:03:26.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43382025-07-18T00:03:26.504ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43392025-07-18T00:03:26.504ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43402025-07-18T00:03:26.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43412025-07-18T00:03:26.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43422025-07-18T00:03:26.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43432025-07-18T00:03:26.512ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43442025-07-18T00:03:26.512ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("906e16ea-5647-4bb1-87e3-adc1b6425e89"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f64c32b6-6890-4c3e-94cd-b954a3778f0b")}) node_id = 7 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43452025-07-18T00:03:26.513ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43462025-07-18T00:03:26.513ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43472025-07-18T00:03:26.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43482025-07-18T00:03:26.515ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43492025-07-18T00:03:26.516ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43502025-07-18T00:03:26.516ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43512025-07-18T00:03:26.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43522025-07-18T00:03:26.521ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43532025-07-18T00:03:26.521ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43542025-07-18T00:03:26.529ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43552025-07-18T00:03:26.529ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43562025-07-18T00:03:26.536ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43572025-07-18T00:03:26.536ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43582025-07-18T00:03:26.542ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43592025-07-18T00:03:26.542ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43602025-07-18T00:03:26.542ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "92696b91-c102-4ac0-b184-b29042a800ba", "content-length": "372", "date": "Fri, 18 Jul 2025 00:03:26 GMT"} })
43612025-07-18T00:03:26.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43622025-07-18T00:03:26.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43632025-07-18T00:03:26.543ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:82 instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 propolis_id = f64c32b6-6890-4c3e-94cd-b954a3778f0b saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
43642025-07-18T00:03:26.543ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ReleaseSledResources
43652025-07-18T00:03:26.544ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ReleaseSledResources
43662025-07-18T00:03:26.558ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {8795b04b-3a00-4cbb-a2e9-10b29de29924: {10.151.2.176: {e8d99606-cb14-479a-8fbd-52c17be7a1bb}, 10.151.2.175: {e8d99606-cb14-479a-8fbd-52c17be7a1bb}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
43672025-07-18T00:03:26.558ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
43682025-07-18T00:03:26.558ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e94253b0-bb21-409e-b242-19434bd38b36", "date": "Fri, 18 Jul 2025 00:03:26 GMT"} })
43692025-07-18T00:03:26.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43702025-07-18T00:03:26.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43712025-07-18T00:03:26.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43722025-07-18T00:03:26.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43732025-07-18T00:03:26.561ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43742025-07-18T00:03:26.562ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e90c956-0222-4156-9b42-890eab5dfe78", "content-length": "691", "date": "Fri, 18 Jul 2025 00:03:26 GMT"} })
43752025-07-18T00:03:26.562ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
43762025-07-18T00:03:26.562ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
43772025-07-18T00:03:26.562ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
43782025-07-18T00:03:26.563ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 75.876168ms iteration = 25 status = {}
43792025-07-18T00:03:26.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43802025-07-18T00:03:26.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43812025-07-18T00:03:26.567ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
43822025-07-18T00:03:26.567ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43832025-07-18T00:03:26.568ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e187b051-ff35-426f-b25e-18efae84e23e", "date": "Fri, 18 Jul 2025 00:03:26 GMT"} })
43842025-07-18T00:03:26.570ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 82.327787ms iteration = 25 status = {}
43852025-07-18T00:03:26.573ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43862025-07-18T00:03:26.574ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43872025-07-18T00:03:26.582ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43882025-07-18T00:03:26.582ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43892025-07-18T00:03:26.591ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:113 instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 propolis_id = f64c32b6-6890-4c3e-94cd-b954a3778f0b saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
43902025-07-18T00:03:26.591ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = MarkVmmDeleted
43912025-07-18T00:03:26.591ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = MarkVmmDeleted
43922025-07-18T00:03:26.609ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43932025-07-18T00:03:26.609ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43942025-07-18T00:03:26.616ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43952025-07-18T00:03:26.616ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43962025-07-18T00:03:26.625ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43972025-07-18T00:03:26.625ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
43982025-07-18T00:03:26.630ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
43992025-07-18T00:03:26.630ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
44002025-07-18T00:03:26.636ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ChainSuccessorSaga
44012025-07-18T00:03:26.637ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ChainSuccessorSaga
44022025-07-18T00:03:26.638ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ChainSuccessorSaga
44032025-07-18T00:03:26.638ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ChainSuccessorSaga
44042025-07-18T00:03:26.639ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ChainSuccessorSaga
44052025-07-18T00:03:26.640ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ChainSuccessorSaga
44062025-07-18T00:03:26.641ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ChainSuccessorSaga
44072025-07-18T00:03:26.644ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f37123ec-61ff-4793-867b-6920b7f6246a, lookup_type: ById(f37123ec-61ff-4793-867b-6920b7f6246a) }, key: 94db2073-cec5-48dd-b6b6-28c3e6fabb6e, lookup_type: ById(94db2073-cec5-48dd-b6b6-28c3e6fabb6e) }, key: 906e16ea-5647-4bb1-87e3-adc1b6425e89, lookup_type: ById(906e16ea-5647-4bb1-87e3-adc1b6425e89) } result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ChainSuccessorSaga
44082025-07-18T00:03:26.644ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ChainSuccessorSaga
44092025-07-18T00:03:26.644ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_node = ChainSuccessorSaga
44102025-07-18T00:03:26.649ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 intended_state = destroyed karmic_state = WillReincarnate needs_reincarnation = false saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update
44112025-07-18T00:03:26.649ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
44122025-07-18T00:03:26.649ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
44132025-07-18T00:03:26.653ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
44142025-07-18T00:03:26.653ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
44152025-07-18T00:03:26.657ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
44162025-07-18T00:03:26.658ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
44172025-07-18T00:03:26.662ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
44182025-07-18T00:03:26.662ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = a0518321-fa6a-4483-8f66-07b6a7616784
44192025-07-18T00:03:26.679ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
44202025-07-18T00:03:26.679ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 saga_name = instance-update saga_result = SagaResult { saga_id: a0518321-fa6a-4483-8f66-07b6a7616784, saga_log: SagaLog { saga_id: a0518321-fa6a-4483-8f66-07b6a7616784, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("33aaacfc-9f15-4b0d-b7af-325e2fe5735d")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("33aaacfc-9f15-4b0d-b7af-325e2fe5735d")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("906e16ea-5647-4bb1-87e3-adc1b6425e89"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f64c32b6-6890-4c3e-94cd-b954a3778f0b")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("906e16ea-5647-4bb1-87e3-adc1b6425e89"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f64c32b6-6890-4c3e-94cd-b954a3778f0b")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("33aaacfc-9f15-4b0d-b7af-325e2fe5735d"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("33aaacfc-9f15-4b0d-b7af-325e2fe5735d")}} }) }
44212025-07-18T00:03:26.680ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = a0518321-fa6a-4483-8f66-07b6a7616784 instance_id = 906e16ea-5647-4bb1-87e3-adc1b6425e89 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update
44222025-07-18T00:03:26.680ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
44232025-07-18T00:03:26.680ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d
44242025-07-18T00:03:26.686ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
44252025-07-18T00:03:26.686ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d
44262025-07-18T00:03:26.693ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
44272025-07-18T00:03:26.693ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d
44282025-07-18T00:03:26.700ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
44292025-07-18T00:03:26.700ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d
44302025-07-18T00:03:26.765ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update sec_id = 79e7c92c-8e83-4180-bbfe-92325edee698
44312025-07-18T00:03:26.765ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 43c8189f-fbd7-4d84-89af-6c8eca64957d saga_name = start-instance-update saga_result = SagaResult { saga_id: 43c8189f-fbd7-4d84-89af-6c8eca64957d, saga_log: SagaLog { saga_id: 43c8189f-fbd7-4d84-89af-6c8eca64957d, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("5d34f74c-8209-4a7e-99c6-7c2b155135ab")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("5d34f74c-8209-4a7e-99c6-7c2b155135ab")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("5d34f74c-8209-4a7e-99c6-7c2b155135ab"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("5d34f74c-8209-4a7e-99c6-7c2b155135ab")}} }) }
44322025-07-18T00:03:27.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 01891e6a-ba0b-4215-847d-27d0fd3a8ff3 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44332025-07-18T00:03:27.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 01891e6a-ba0b-4215-847d-27d0fd3a8ff3 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44342025-07-18T00:03:27.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 01891e6a-ba0b-4215-847d-27d0fd3a8ff3 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44352025-07-18T00:03:28.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0eeae2e2-9f4e-4346-a60c-7fac96aeb76a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44362025-07-18T00:03:28.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0eeae2e2-9f4e-4346-a60c-7fac96aeb76a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44372025-07-18T00:03:28.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0eeae2e2-9f4e-4346-a60c-7fac96aeb76a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44382025-07-18T00:03:29.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 01292974-3384-4cb5-972e-c582caa3bfec roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44392025-07-18T00:03:29.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 01292974-3384-4cb5-972e-c582caa3bfec resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44402025-07-18T00:03:29.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 01292974-3384-4cb5-972e-c582caa3bfec response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44412025-07-18T00:03:30.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 141 reason = Timeout
44422025-07-18T00:03:30.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44432025-07-18T00:03:30.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44442025-07-18T00:03:30.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44452025-07-18T00:03:30.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
44462025-07-18T00:03:30.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44472025-07-18T00:03:30.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44482025-07-18T00:03:30.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
44492025-07-18T00:03:30.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
44502025-07-18T00:03:30.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44512025-07-18T00:03:30.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44522025-07-18T00:03:30.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44532025-07-18T00:03:30.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44542025-07-18T00:03:30.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
44552025-07-18T00:03:30.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.391019ms iteration = 141 status = {"chicken_switches_updated":false}
44562025-07-18T00:03:30.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44572025-07-18T00:03:30.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44582025-07-18T00:03:30.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44592025-07-18T00:03:30.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.374512ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44602025-07-18T00:03:30.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44612025-07-18T00:03:30.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44622025-07-18T00:03:30.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44632025-07-18T00:03:30.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44642025-07-18T00:03:30.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44652025-07-18T00:03:30.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44662025-07-18T00:03:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
44672025-07-18T00:03:30.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44682025-07-18T00:03:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44692025-07-18T00:03:30.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
44702025-07-18T00:03:30.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.620727ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
44712025-07-18T00:03:30.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 58622dc6-c5b2-49a7-a541-1673384638ff roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44722025-07-18T00:03:30.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 58622dc6-c5b2-49a7-a541-1673384638ff resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44732025-07-18T00:03:30.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 58622dc6-c5b2-49a7-a541-1673384638ff response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44742025-07-18T00:03:30.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 642 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = f3d1fadd-6bd8-4583-9dfa-10ebfa3c4406 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
44752025-07-18T00:03:31.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 427ecab7-a5f5-48ef-9803-9fe44f76e45e roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44762025-07-18T00:03:31.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 427ecab7-a5f5-48ef-9803-9fe44f76e45e resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44772025-07-18T00:03:31.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 427ecab7-a5f5-48ef-9803-9fe44f76e45e response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44782025-07-18T00:03:32.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4538fbd9-7360-4e38-a616-b9e71354cc02 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44792025-07-18T00:03:32.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4538fbd9-7360-4e38-a616-b9e71354cc02 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44802025-07-18T00:03:32.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4538fbd9-7360-4e38-a616-b9e71354cc02 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44812025-07-18T00:03:33.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a640c6a2-7725-4f3f-9b8c-d21a01e68a03 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44822025-07-18T00:03:33.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a640c6a2-7725-4f3f-9b8c-d21a01e68a03 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44832025-07-18T00:03:33.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a640c6a2-7725-4f3f-9b8c-d21a01e68a03 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44842025-07-18T00:03:34.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 315670a5-af2c-4d68-a7e1-66c3fee42c5e roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44852025-07-18T00:03:34.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 315670a5-af2c-4d68-a7e1-66c3fee42c5e resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44862025-07-18T00:03:34.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 315670a5-af2c-4d68-a7e1-66c3fee42c5e response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44872025-07-18T00:03:35.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 142 reason = Timeout
44882025-07-18T00:03:35.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44892025-07-18T00:03:35.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44902025-07-18T00:03:35.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44912025-07-18T00:03:35.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
44922025-07-18T00:03:35.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44932025-07-18T00:03:35.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44942025-07-18T00:03:35.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
44952025-07-18T00:03:35.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.038443ms iteration = 142 status = {"chicken_switches_updated":false}
44962025-07-18T00:03:35.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bb7b9e3f-ce4f-44f5-8420-777475c480dd roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44972025-07-18T00:03:35.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bb7b9e3f-ce4f-44f5-8420-777475c480dd resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44982025-07-18T00:03:35.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bb7b9e3f-ce4f-44f5-8420-777475c480dd response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
44992025-07-18T00:03:36.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 54d406ca-c314-42b8-89fe-bc6f861f9a67 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45002025-07-18T00:03:36.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 54d406ca-c314-42b8-89fe-bc6f861f9a67 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45012025-07-18T00:03:36.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 54d406ca-c314-42b8-89fe-bc6f861f9a67 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45022025-07-18T00:03:37.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 555688d1-e3bd-48bc-8d83-16c192266b17 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45032025-07-18T00:03:37.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 555688d1-e3bd-48bc-8d83-16c192266b17 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45042025-07-18T00:03:37.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 555688d1-e3bd-48bc-8d83-16c192266b17 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45052025-07-18T00:03:38.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 73f9c0f6-03d0-43bb-b0cd-be21185a5122 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45062025-07-18T00:03:38.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 73f9c0f6-03d0-43bb-b0cd-be21185a5122 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45072025-07-18T00:03:38.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 73f9c0f6-03d0-43bb-b0cd-be21185a5122 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45082025-07-18T00:03:39.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3b7f843a-5e17-428f-a79b-4fdceed981e6 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45092025-07-18T00:03:39.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3b7f843a-5e17-428f-a79b-4fdceed981e6 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45102025-07-18T00:03:39.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3b7f843a-5e17-428f-a79b-4fdceed981e6 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45112025-07-18T00:03:40.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 143 reason = Timeout
45122025-07-18T00:03:40.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
45132025-07-18T00:03:40.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
45142025-07-18T00:03:40.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45152025-07-18T00:03:40.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
45162025-07-18T00:03:40.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
45172025-07-18T00:03:40.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
45182025-07-18T00:03:40.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
45192025-07-18T00:03:40.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
45202025-07-18T00:03:40.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45212025-07-18T00:03:40.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45222025-07-18T00:03:40.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45232025-07-18T00:03:40.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45242025-07-18T00:03:40.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
45252025-07-18T00:03:40.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.208111ms iteration = 143 status = {"chicken_switches_updated":false}
45262025-07-18T00:03:40.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45272025-07-18T00:03:40.218ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45282025-07-18T00:03:40.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45292025-07-18T00:03:40.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.51514ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45302025-07-18T00:03:40.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45312025-07-18T00:03:40.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45322025-07-18T00:03:40.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45332025-07-18T00:03:40.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45342025-07-18T00:03:40.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45352025-07-18T00:03:40.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45362025-07-18T00:03:40.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
45372025-07-18T00:03:40.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45382025-07-18T00:03:40.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45392025-07-18T00:03:40.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
45402025-07-18T00:03:40.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.145936ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
45412025-07-18T00:03:40.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 15ca3e43-1e19-4e3f-8061-631f95097efb roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45422025-07-18T00:03:40.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 15ca3e43-1e19-4e3f-8061-631f95097efb resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45432025-07-18T00:03:40.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 15ca3e43-1e19-4e3f-8061-631f95097efb response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45442025-07-18T00:03:40.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 625 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = e9139526-0acf-4bc8-8981-efa60b2163b3 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
45452025-07-18T00:03:41.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 10452b4b-77bd-40dc-8c3e-c4882441e19f roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45462025-07-18T00:03:41.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 10452b4b-77bd-40dc-8c3e-c4882441e19f resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45472025-07-18T00:03:41.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 10452b4b-77bd-40dc-8c3e-c4882441e19f response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45482025-07-18T00:03:42.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 55c3d167-795d-4500-b9b5-5fc9eaa3fed7 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45492025-07-18T00:03:42.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 55c3d167-795d-4500-b9b5-5fc9eaa3fed7 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45502025-07-18T00:03:42.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 55c3d167-795d-4500-b9b5-5fc9eaa3fed7 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45512025-07-18T00:03:43.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48c5b026-cc2b-4aae-8ec3-c1ec13c9187e roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45522025-07-18T00:03:43.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48c5b026-cc2b-4aae-8ec3-c1ec13c9187e resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45532025-07-18T00:03:43.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 48c5b026-cc2b-4aae-8ec3-c1ec13c9187e response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45542025-07-18T00:03:44.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 28ab03ff-bf56-4a0c-a5eb-114c1b93f773 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45552025-07-18T00:03:44.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 28ab03ff-bf56-4a0c-a5eb-114c1b93f773 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45562025-07-18T00:03:44.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 28ab03ff-bf56-4a0c-a5eb-114c1b93f773 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45572025-07-18T00:03:45.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 144 reason = Timeout
45582025-07-18T00:03:45.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
45592025-07-18T00:03:45.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
45602025-07-18T00:03:45.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45612025-07-18T00:03:45.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
45622025-07-18T00:03:45.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
45632025-07-18T00:03:45.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
45642025-07-18T00:03:45.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
45652025-07-18T00:03:45.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.874216ms iteration = 144 status = {"chicken_switches_updated":false}
45662025-07-18T00:03:45.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3d06e42e-89d9-496d-8d8a-b2db3ddc3815 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45672025-07-18T00:03:45.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3d06e42e-89d9-496d-8d8a-b2db3ddc3815 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45682025-07-18T00:03:45.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2677 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3d06e42e-89d9-496d-8d8a-b2db3ddc3815 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45692025-07-18T00:03:46.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 81e9cab1-0a18-4160-8d93-be909e8f2c16 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45702025-07-18T00:03:46.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 81e9cab1-0a18-4160-8d93-be909e8f2c16 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45712025-07-18T00:03:46.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 81e9cab1-0a18-4160-8d93-be909e8f2c16 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45722025-07-18T00:03:47.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 837c10b6-0ebd-46e0-bc51-8ae0bc53419f roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45732025-07-18T00:03:47.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 837c10b6-0ebd-46e0-bc51-8ae0bc53419f resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45742025-07-18T00:03:47.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 837c10b6-0ebd-46e0-bc51-8ae0bc53419f response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45752025-07-18T00:03:48.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ed6a0c4f-e8e1-41c1-83ea-2f7fecf7f434 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45762025-07-18T00:03:48.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ed6a0c4f-e8e1-41c1-83ea-2f7fecf7f434 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45772025-07-18T00:03:48.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ed6a0c4f-e8e1-41c1-83ea-2f7fecf7f434 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45782025-07-18T00:03:49.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 459391dc-a1f6-4bd5-be95-776cb508e282 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45792025-07-18T00:03:49.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 459391dc-a1f6-4bd5-be95-776cb508e282 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45802025-07-18T00:03:49.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 459391dc-a1f6-4bd5-be95-776cb508e282 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
45812025-07-18T00:03:50.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
45822025-07-18T00:03:50.206ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
45832025-07-18T00:03:50.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45842025-07-18T00:03:50.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45852025-07-18T00:03:50.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45862025-07-18T00:03:50.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45872025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
45882025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
45892025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
45902025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
45912025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
45922025-07-18T00:03:50.208ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-17 23:53:50.208254430 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
45932025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
45942025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
45952025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45962025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
45972025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
45982025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45992025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
46002025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
46012025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46022025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46032025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
46042025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
46052025-07-18T00:03:50.208ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 9092da00-a622-42cf-99af-453ea64d4a35
46062025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.481\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"9092da00-a622-42cf-99af-453ea64d4a35"}
46072025-07-18T00:03:50.208ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("464a3447-fe1f-417e-b585-925f5fb5bfdc.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da3261f0-45ba-4fbf-b6bb-a5a70850db80.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("da3261f0-45ba-4fbf-b6bb-a5a70850db80.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 286003938 } })
46082025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
46092025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46102025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46112025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46122025-07-18T00:03:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46132025-07-18T00:03:50.208ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("56b8d8b3-74d8-49ff-9bba-ff575bfeff38.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b6789fb-7f6d-466d-9e8d-08234eb15cb4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eee78e3b-9d92-4bbf-a496-9511487338e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("eee78e3b-9d92-4bbf-a496-9511487338e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:3::1)) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 286210611 } })
46142025-07-18T00:03:50.209ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
46152025-07-18T00:03:50.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 870.593\u{b5}s iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
46162025-07-18T00:03:50.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46172025-07-18T00:03:50.209ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
46182025-07-18T00:03:50.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.031436ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
46192025-07-18T00:03:50.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46202025-07-18T00:03:50.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 145 reason = Timeout
46212025-07-18T00:03:50.209ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 17 reason = Timeout
46222025-07-18T00:03:50.209ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
46232025-07-18T00:03:50.209ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 5.75\u{b5}s iteration = 17 status = "Disabled"
46242025-07-18T00:03:50.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
46252025-07-18T00:03:50.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
46262025-07-18T00:03:50.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46272025-07-18T00:03:50.210ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-17 23:53:50.208254430 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
46282025-07-18T00:03:50.210ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.57272ms iteration = 13 status = {"expiration":"2025-07-17T23:53:50.208254430Z","pruned":[]}
46292025-07-18T00:03:50.211ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46302025-07-18T00:03:50.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 289192037 } })
46312025-07-18T00:03:50.212ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
46322025-07-18T00:03:50.212ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.173084ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46332025-07-18T00:03:50.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46342025-07-18T00:03:50.212ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 290136821 } })
46352025-07-18T00:03:50.213ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
46362025-07-18T00:03:50.213ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46372025-07-18T00:03:50.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46382025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46392025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46402025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46412025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
46422025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
46432025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
46442025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46452025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
46462025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
46472025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
46482025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46492025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
46502025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46512025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
46522025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46532025-07-18T00:03:50.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
46542025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46552025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
46562025-07-18T00:03:50.216ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46572025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46582025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
46592025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46602025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46612025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
46622025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46632025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
46642025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46652025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
46662025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
46672025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
46682025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46692025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
46702025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46712025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
46722025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
46732025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
46742025-07-18T00:03:50.216ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
46752025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46762025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
46772025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46782025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46792025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46802025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46812025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46822025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
46832025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
46842025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46852025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46862025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46872025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46882025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46892025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46902025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46912025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
46922025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
46932025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46942025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46952025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
46962025-07-18T00:03:50.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
46972025-07-18T00:03:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
46982025-07-18T00:03:50.217ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
46992025-07-18T00:03:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
47002025-07-18T00:03:50.217ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
47012025-07-18T00:03:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
47022025-07-18T00:03:50.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47032025-07-18T00:03:50.218ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47042025-07-18T00:03:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47052025-07-18T00:03:50.218ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47062025-07-18T00:03:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
47072025-07-18T00:03:50.218ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
47082025-07-18T00:03:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47092025-07-18T00:03:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
47102025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
47112025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
47122025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
47132025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47142025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
47152025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47162025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47172025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
47182025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
47192025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47202025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
47212025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47222025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 13 reason = Timeout
47232025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
47242025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
47252025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
47262025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
47272025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 25 reason = Timeout
47282025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 13 reason = Timeout
47292025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
47302025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
47312025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47322025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
47332025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
47342025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
47352025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
47362025-07-18T00:03:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
47372025-07-18T00:03:50.220ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 297483315 } })
47382025-07-18T00:03:50.220ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47392025-07-18T00:03:50.220ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47402025-07-18T00:03:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47412025-07-18T00:03:50.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47422025-07-18T00:03:50.222ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47432025-07-18T00:03:50.222ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47442025-07-18T00:03:50.222ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47452025-07-18T00:03:50.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47462025-07-18T00:03:50.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47472025-07-18T00:03:50.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47482025-07-18T00:03:50.223ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47492025-07-18T00:03:50.223ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47502025-07-18T00:03:50.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47512025-07-18T00:03:50.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47522025-07-18T00:03:50.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47532025-07-18T00:03:50.224ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47542025-07-18T00:03:50.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
47552025-07-18T00:03:50.225ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
47562025-07-18T00:03:50.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47572025-07-18T00:03:50.225ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47582025-07-18T00:03:50.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47592025-07-18T00:03:50.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
47602025-07-18T00:03:50.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47612025-07-18T00:03:50.226ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47622025-07-18T00:03:50.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47632025-07-18T00:03:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47642025-07-18T00:03:50.226ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47652025-07-18T00:03:50.228ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47662025-07-18T00:03:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47672025-07-18T00:03:50.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47682025-07-18T00:03:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47692025-07-18T00:03:50.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47702025-07-18T00:03:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47712025-07-18T00:03:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47722025-07-18T00:03:50.229ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47732025-07-18T00:03:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47742025-07-18T00:03:50.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47752025-07-18T00:03:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47762025-07-18T00:03:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47772025-07-18T00:03:50.229ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47782025-07-18T00:03:50.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47792025-07-18T00:03:50.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
47802025-07-18T00:03:50.231ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47812025-07-18T00:03:50.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47822025-07-18T00:03:50.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47832025-07-18T00:03:50.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47842025-07-18T00:03:50.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.701192ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
47852025-07-18T00:03:50.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
47862025-07-18T00:03:50.237ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
47872025-07-18T00:03:50.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
47882025-07-18T00:03:50.237ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47892025-07-18T00:03:50.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
47902025-07-18T00:03:50.237ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47912025-07-18T00:03:50.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47922025-07-18T00:03:50.237ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
47932025-07-18T00:03:50.237ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 27.610235ms iteration = 145 status = {"chicken_switches_updated":false}
47942025-07-18T00:03:50.240ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
47952025-07-18T00:03:50.240ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 20.198641ms iteration = 13 status = {"by_rx":{},"error":null}
47962025-07-18T00:03:50.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
47972025-07-18T00:03:50.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
47982025-07-18T00:03:50.240ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.057294ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
47992025-07-18T00:03:50.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48002025-07-18T00:03:50.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 22.184482ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
48012025-07-18T00:03:50.248ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 28.694182ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
48022025-07-18T00:03:50.253ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
48032025-07-18T00:03:50.253ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2be4d985-6e68-40d2-a5d1-ba1e291e5f99 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
48042025-07-18T00:03:50.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48052025-07-18T00:03:50.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48062025-07-18T00:03:50.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48072025-07-18T00:03:50.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48082025-07-18T00:03:50.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48092025-07-18T00:03:50.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48102025-07-18T00:03:50.259ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 337213566 } })
48112025-07-18T00:03:50.260ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
48122025-07-18T00:03:50.266ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48132025-07-18T00:03:50.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48142025-07-18T00:03:50.273ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
48152025-07-18T00:03:50.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48162025-07-18T00:03:50.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
48172025-07-18T00:03:50.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48182025-07-18T00:03:50.277ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48192025-07-18T00:03:50.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48202025-07-18T00:03:50.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48212025-07-18T00:03:50.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48222025-07-18T00:03:50.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
48232025-07-18T00:03:50.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48242025-07-18T00:03:50.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48252025-07-18T00:03:50.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48262025-07-18T00:03:50.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48272025-07-18T00:03:50.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48282025-07-18T00:03:50.295ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 76.064702ms iteration = 13 status = {"dispatched":[],"errors":[],"glob_version":"165.0.0","globs_reprocessed":{},"no_receivers":[]}
48292025-07-18T00:03:50.296ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48302025-07-18T00:03:50.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
48312025-07-18T00:03:50.299ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48322025-07-18T00:03:50.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48332025-07-18T00:03:50.303ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2be4d985-6e68-40d2-a5d1-ba1e291e5f99 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
48342025-07-18T00:03:50.303ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
48352025-07-18T00:03:50.303ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-17 23:52:10.609253 UTC dns_group = internal generation = 1
48362025-07-18T00:03:50.303ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 97.44587ms iteration = 13 status = {"generation":1}
48372025-07-18T00:03:50.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48382025-07-18T00:03:50.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48392025-07-18T00:03:50.309ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48402025-07-18T00:03:50.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
48412025-07-18T00:03:50.313ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48422025-07-18T00:03:50.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48432025-07-18T00:03:50.315ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48442025-07-18T00:03:50.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48452025-07-18T00:03:50.317ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48462025-07-18T00:03:50.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48472025-07-18T00:03:50.318ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 102.6055ms iteration = 6 status = {"nsuccess":5}
48482025-07-18T00:03:50.319ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
48492025-07-18T00:03:50.319ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
48502025-07-18T00:03:50.319ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.214939ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
48512025-07-18T00:03:50.322ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
48522025-07-18T00:03:50.322ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
48532025-07-18T00:03:50.322ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 106.326267ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
48542025-07-18T00:03:50.324ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 108.128985ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48552025-07-18T00:03:50.324ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
48562025-07-18T00:03:50.324ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 108.297947ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
48572025-07-18T00:03:50.328ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 112.226058ms iteration = 28 status = {"physical_disks_added":0}
48582025-07-18T00:03:50.328ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48592025-07-18T00:03:50.329ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
48602025-07-18T00:03:50.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
48612025-07-18T00:03:50.330ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
48622025-07-18T00:03:50.330ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
48632025-07-18T00:03:50.330ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
48642025-07-18T00:03:50.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48652025-07-18T00:03:50.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48662025-07-18T00:03:50.331ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48672025-07-18T00:03:50.332ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48682025-07-18T00:03:50.332ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48692025-07-18T00:03:50.332ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48702025-07-18T00:03:50.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48712025-07-18T00:03:50.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48722025-07-18T00:03:50.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48732025-07-18T00:03:50.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48742025-07-18T00:03:50.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48752025-07-18T00:03:50.333ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
48762025-07-18T00:03:50.333ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 117.472488ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
48772025-07-18T00:03:50.333ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48782025-07-18T00:03:50.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48792025-07-18T00:03:50.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
48802025-07-18T00:03:50.336ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
48812025-07-18T00:03:50.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
48822025-07-18T00:03:50.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48832025-07-18T00:03:50.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48842025-07-18T00:03:50.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48852025-07-18T00:03:50.343ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48862025-07-18T00:03:50.346ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48872025-07-18T00:03:50.346ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48882025-07-18T00:03:50.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48892025-07-18T00:03:50.355ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48902025-07-18T00:03:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48912025-07-18T00:03:50.358ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48922025-07-18T00:03:50.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48932025-07-18T00:03:50.359ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48942025-07-18T00:03:50.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, lookup_type: ById(4a597d98-bd6a-42be-a09e-71b1fbba6de5) } result = Ok(())
48952025-07-18T00:03:50.362ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48962025-07-18T00:03:50.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48972025-07-18T00:03:50.366ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 150.269364ms iteration = 25 status = 0
48982025-07-18T00:03:50.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48992025-07-18T00:03:50.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49002025-07-18T00:03:50.373ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 154.289585ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49012025-07-18T00:03:50.375ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 159.610668ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49022025-07-18T00:03:50.398ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49032025-07-18T00:03:50.398ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49042025-07-18T00:03:50.398ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 182.967317ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
49052025-07-18T00:03:50.411ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:389
49062025-07-18T00:03:50.411ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 195.569411ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
49072025-07-18T00:03:50.414ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
49082025-07-18T00:03:50.414ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a5c2ae61-5a10-495b-8726-f2f7ed24b4a0 dns_zone_name = oxide.test found_so_far = 0 version = 2
49092025-07-18T00:03:50.414ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49102025-07-18T00:03:50.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49112025-07-18T00:03:50.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49122025-07-18T00:03:50.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49132025-07-18T00:03:50.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49142025-07-18T00:03:50.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49152025-07-18T00:03:50.422ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-17T23:51:46.880014Z, time_modified: 2025-07-17T23:51:46.880014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f37123ec-61ff-4793-867b-6920b7f6246a, db_silo: Silo { identity: SiloIdentity { id: f37123ec-61ff-4793-867b-6920b7f6246a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-17T23:52:11.102986Z, time_modified: 2025-07-17T23:52:11.102986Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f37123ec-61ff-4793-867b-6920b7f6246a, db_silo: Silo { identity: SiloIdentity { id: f37123ec-61ff-4793-867b-6920b7f6246a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-17T23:52:11.102986Z, time_modified: 2025-07-17T23:52:11.102986Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
49162025-07-18T00:03:50.423ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 214.704666ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f37123ec-61ff-4793-867b-6920b7f6246a","tls_certs":["6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3"]}},"default_endpoint":{"silo_id":"f37123ec-61ff-4793-867b-6920b7f6246a","tls_certs":["6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
49172025-07-18T00:03:50.424ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a5c2ae61-5a10-495b-8726-f2f7ed24b4a0 dns_zone_name = oxide.test found_so_far = 4 version = 2
49182025-07-18T00:03:50.424ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
49192025-07-18T00:03:50.424ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-17 23:52:11.153706 UTC dns_group = external generation = 2
49202025-07-18T00:03:50.425ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 216.639146ms iteration = 13 status = {"generation":2}
49212025-07-18T00:03:50.426ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 207.25132ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
49222025-07-18T00:03:50.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49232025-07-18T00:03:50.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49242025-07-18T00:03:50.447ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
49252025-07-18T00:03:50.447ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49262025-07-18T00:03:50.447ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0af4583a-fdf7-4ac5-bb6f-14ae9f26487d", "content-length": "26", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} })
49272025-07-18T00:03:50.447ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49282025-07-18T00:03:50.460ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49292025-07-18T00:03:50.471ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
49302025-07-18T00:03:50.471ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "1af9b8d3-9374-4f8a-9de1-ba067c39212d", "content-length": "78", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} })
49312025-07-18T00:03:50.471ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
49322025-07-18T00:03:50.471ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
49332025-07-18T00:03:50.471ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
49342025-07-18T00:03:50.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
49352025-07-18T00:03:50.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
49362025-07-18T00:03:50.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
49372025-07-18T00:03:50.474ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
49382025-07-18T00:03:50.475ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
49392025-07-18T00:03:50.478ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
49402025-07-18T00:03:50.480ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
49412025-07-18T00:03:50.482ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
49422025-07-18T00:03:50.482ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
49432025-07-18T00:03:50.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
49442025-07-18T00:03:50.484ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
49452025-07-18T00:03:50.484ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
49462025-07-18T00:03:50.484ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
49472025-07-18T00:03:50.484ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
49482025-07-18T00:03:50.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
49492025-07-18T00:03:50.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
49502025-07-18T00:03:50.485ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 zone_address = fd00:1122:3344:101::2
49512025-07-18T00:03:50.485ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49522025-07-18T00:03:50.486ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "70068944-4deb-4c90-8397-55f5c508f20a", "content-length": "26", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} })
49532025-07-18T00:03:50.486ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49542025-07-18T00:03:50.488ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
49552025-07-18T00:03:50.488ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
49562025-07-18T00:03:50.489ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "99a62f26-63f4-49c0-8473-5855570c3ee2", "content-length": "81", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} })
49572025-07-18T00:03:50.490ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
49582025-07-18T00:03:50.490ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
49592025-07-18T00:03:50.490ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
49602025-07-18T00:03:50.491ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "153e71e7-055d-4cbf-9ee3-e14eb65d7540", "content-length": "81", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} })
49612025-07-18T00:03:50.497ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49622025-07-18T00:03:50.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49632025-07-18T00:03:50.500ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49642025-07-18T00:03:50.503ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49652025-07-18T00:03:50.503ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49662025-07-18T00:03:50.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49672025-07-18T00:03:50.505ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49682025-07-18T00:03:50.509ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49692025-07-18T00:03:50.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49702025-07-18T00:03:50.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49712025-07-18T00:03:50.521ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
49722025-07-18T00:03:50.521ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49732025-07-18T00:03:50.521ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bedd8c1-763e-4047-9025-5124294614f8", "content-length": "26", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} })
49742025-07-18T00:03:50.521ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49752025-07-18T00:03:50.523ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49762025-07-18T00:03:50.544ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
49772025-07-18T00:03:50.544ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
49782025-07-18T00:03:50.544ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "c02abdf5-4f78-463d-9001-50c0291a395c", "content-length": "81", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} })
49792025-07-18T00:03:50.546ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 327.014235ms iteration = 25 status = {"errors":[],"sps":[]}
49802025-07-18T00:03:50.551ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
49812025-07-18T00:03:50.551ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49822025-07-18T00:03:50.552ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "42798a4b-58cb-4565-b057-dc8c023a500d", "content-length": "372", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} })
49832025-07-18T00:03:50.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49842025-07-18T00:03:50.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49852025-07-18T00:03:50.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 385895e2-091e-494f-a96e-a63ceefd846f roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
49862025-07-18T00:03:50.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 385895e2-091e-494f-a96e-a63ceefd846f resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
49872025-07-18T00:03:50.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 385895e2-091e-494f-a96e-a63ceefd846f response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
49882025-07-18T00:03:50.581ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
49892025-07-18T00:03:50.617ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
49902025-07-18T00:03:50.617ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 401.830276ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
49912025-07-18T00:03:50.618ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
49922025-07-18T00:03:50.618ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49932025-07-18T00:03:50.618ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e35c4d9d-0892-4903-a1da-4ef85af039c4", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} })
49942025-07-18T00:03:50.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49952025-07-18T00:03:50.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49962025-07-18T00:03:50.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49972025-07-18T00:03:50.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49982025-07-18T00:03:50.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49992025-07-18T00:03:50.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50002025-07-18T00:03:50.627ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
50012025-07-18T00:03:50.627ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50022025-07-18T00:03:50.628ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a72a2229-c707-45f9-8a4a-bcaa95f081f2", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} })
50032025-07-18T00:03:50.631ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 415.129821ms iteration = 26 status = {}
50042025-07-18T00:03:50.631ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 423.656462ms iteration = 25 status = {}
50052025-07-18T00:03:50.790ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
50062025-07-18T00:03:50.791ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6fd42fee-759e-4217-be78-87ff63288c37", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50072025-07-18T00:03:50.791ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50082025-07-18T00:03:50.793ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8d98abd7-680e-49bb-9e50-4e6e427228ec", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50092025-07-18T00:03:50.793ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50102025-07-18T00:03:50.795ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50112025-07-18T00:03:50.795ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 587.074058ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
50122025-07-18T00:03:50.805ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50132025-07-18T00:03:50.808ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "96b2d3d7-375a-4528-b619-36c17bc2c9fe", "content-length": "691", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} })
50142025-07-18T00:03:50.808ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
50152025-07-18T00:03:50.808ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
50162025-07-18T00:03:50.808ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
50172025-07-18T00:03:50.810ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 594.414311ms iteration = 26 status = {}
50182025-07-18T00:03:50.817ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50192025-07-18T00:03:50.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50202025-07-18T00:03:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 612.050553ms iteration = 25 status = null
50212025-07-18T00:03:50.828ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
50222025-07-18T00:03:50.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50232025-07-18T00:03:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50242025-07-18T00:03:50.869ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a2d734dc-e0c9-4fd6-b442-f2c4e63791e5, rack_id: e4e73d6b-d53c-414c-93a8-eff1ed3c4807, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(9d790dba-5335-4b4c-be2a-58416dc1e8f5) } rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
50252025-07-18T00:03:50.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50262025-07-18T00:03:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50272025-07-18T00:03:50.878ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
50282025-07-18T00:03:50.878ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4bedc6a7-1989-4cbd-b05e-fe5f2f75bf5e", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50292025-07-18T00:03:50.878ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50302025-07-18T00:03:50.880ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
50312025-07-18T00:03:50.880ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 9d790dba-5335-4b4c-be2a-58416dc1e8f5
50322025-07-18T00:03:50.880ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
50332025-07-18T00:03:50.880ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50342025-07-18T00:03:50.880ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50352025-07-18T00:03:50.880ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50362025-07-18T00:03:50.880ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50372025-07-18T00:03:50.880ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50382025-07-18T00:03:50.880ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5d342648-64ae-43e3-9fba-b3f7e1646e65", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50392025-07-18T00:03:50.880ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50402025-07-18T00:03:50.880ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50412025-07-18T00:03:50.880ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50422025-07-18T00:03:50.880ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
50432025-07-18T00:03:50.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50442025-07-18T00:03:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50452025-07-18T00:03:50.882ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8d818904-b067-450a-8acc-42e406e473fd", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50462025-07-18T00:03:50.882ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50472025-07-18T00:03:50.883ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
50482025-07-18T00:03:50.883ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50492025-07-18T00:03:50.884ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
50502025-07-18T00:03:50.884ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 676.443524ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
50512025-07-18T00:03:50.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 623 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 2e8f5d8e-e684-41fc-98db-0cf05f0500c2 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
50522025-07-18T00:03:51.003ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "aa5f8d40-2c07-4445-9714-addc9e0356e0", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} })
50532025-07-18T00:03:51.003ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch = Switch0
50542025-07-18T00:03:51.003ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50552025-07-18T00:03:51.003ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e053272-27bf-4b86-8228-57794375159b", "content-length": "682", "date": "Fri, 18 Jul 2025 00:03:50 GMT"} })
50562025-07-18T00:03:51.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50572025-07-18T00:03:51.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50582025-07-18T00:03:51.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50592025-07-18T00:03:51.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50602025-07-18T00:03:51.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50612025-07-18T00:03:51.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50622025-07-18T00:03:51.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50632025-07-18T00:03:51.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50642025-07-18T00:03:51.019ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 803.858305ms iteration = 25 status = {}
50652025-07-18T00:03:51.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c7d315a2-a5c9-4d73-8bd0-b56e364041d7 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50662025-07-18T00:03:51.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c7d315a2-a5c9-4d73-8bd0-b56e364041d7 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50672025-07-18T00:03:51.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c7d315a2-a5c9-4d73-8bd0-b56e364041d7 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50682025-07-18T00:03:52.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c8a8b05f-1c17-4a6b-80de-57bb95dd1da6 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50692025-07-18T00:03:52.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c8a8b05f-1c17-4a6b-80de-57bb95dd1da6 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50702025-07-18T00:03:52.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c8a8b05f-1c17-4a6b-80de-57bb95dd1da6 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50712025-07-18T00:03:53.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e4a9c3fe-21bb-4b72-9466-3a28f2be02b7 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50722025-07-18T00:03:53.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e4a9c3fe-21bb-4b72-9466-3a28f2be02b7 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50732025-07-18T00:03:53.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e4a9c3fe-21bb-4b72-9466-3a28f2be02b7 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50742025-07-18T00:03:54.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 71804950-ac07-4430-a478-5d8376a0d977 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50752025-07-18T00:03:54.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 71804950-ac07-4430-a478-5d8376a0d977 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50762025-07-18T00:03:54.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2614 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 71804950-ac07-4430-a478-5d8376a0d977 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50772025-07-18T00:03:55.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 146 reason = Timeout
50782025-07-18T00:03:55.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
50792025-07-18T00:03:55.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
50802025-07-18T00:03:55.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50812025-07-18T00:03:55.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
50822025-07-18T00:03:55.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
50832025-07-18T00:03:55.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
50842025-07-18T00:03:55.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
50852025-07-18T00:03:55.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.134999ms iteration = 146 status = {"chicken_switches_updated":false}
50862025-07-18T00:03:55.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1f9762c5-d940-46f5-a063-32bd6e784391 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50872025-07-18T00:03:55.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1f9762c5-d940-46f5-a063-32bd6e784391 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50882025-07-18T00:03:55.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1f9762c5-d940-46f5-a063-32bd6e784391 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50892025-07-18T00:03:56.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 221e3cfc-8027-49d6-95c8-d46a205fe642 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50902025-07-18T00:03:56.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 221e3cfc-8027-49d6-95c8-d46a205fe642 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50912025-07-18T00:03:56.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 221e3cfc-8027-49d6-95c8-d46a205fe642 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50922025-07-18T00:03:57.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a1b216f1-ab27-47d3-990a-40f4deaf643b roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50932025-07-18T00:03:57.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a1b216f1-ab27-47d3-990a-40f4deaf643b resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50942025-07-18T00:03:57.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a1b216f1-ab27-47d3-990a-40f4deaf643b response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50952025-07-18T00:03:58.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2d489ce2-5343-4f28-9d8f-97f69f4c336e roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50962025-07-18T00:03:58.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2d489ce2-5343-4f28-9d8f-97f69f4c336e resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50972025-07-18T00:03:58.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2d489ce2-5343-4f28-9d8f-97f69f4c336e response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50982025-07-18T00:03:59.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8cfcc143-ca6f-4a63-9cba-8bfbd064071a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
50992025-07-18T00:03:59.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8cfcc143-ca6f-4a63-9cba-8bfbd064071a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51002025-07-18T00:03:59.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8cfcc143-ca6f-4a63-9cba-8bfbd064071a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51012025-07-18T00:04:00.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 147 reason = Timeout
51022025-07-18T00:04:00.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
51032025-07-18T00:04:00.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
51042025-07-18T00:04:00.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51052025-07-18T00:04:00.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
51062025-07-18T00:04:00.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
51072025-07-18T00:04:00.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
51082025-07-18T00:04:00.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
51092025-07-18T00:04:00.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51102025-07-18T00:04:00.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
51112025-07-18T00:04:00.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51122025-07-18T00:04:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51132025-07-18T00:04:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51142025-07-18T00:04:00.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
51152025-07-18T00:04:00.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.857126ms iteration = 147 status = {"chicken_switches_updated":false}
51162025-07-18T00:04:00.218ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51172025-07-18T00:04:00.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51182025-07-18T00:04:00.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51192025-07-18T00:04:00.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.333432ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51202025-07-18T00:04:00.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51212025-07-18T00:04:00.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51222025-07-18T00:04:00.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51232025-07-18T00:04:00.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51242025-07-18T00:04:00.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51252025-07-18T00:04:00.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51262025-07-18T00:04:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
51272025-07-18T00:04:00.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51282025-07-18T00:04:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51292025-07-18T00:04:00.241ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
51302025-07-18T00:04:00.241ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.148958ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
51312025-07-18T00:04:00.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ca1c2761-1282-48f6-891c-e1a6f897bb47 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51322025-07-18T00:04:00.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ca1c2761-1282-48f6-891c-e1a6f897bb47 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51332025-07-18T00:04:00.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ca1c2761-1282-48f6-891c-e1a6f897bb47 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51342025-07-18T00:04:00.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 548 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 70fb7cce-336c-4c33-9033-38ea307c8e00 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
51352025-07-18T00:04:01.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f629fcad-b8cb-4303-9f0c-b7d5e45440b5 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51362025-07-18T00:04:01.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f629fcad-b8cb-4303-9f0c-b7d5e45440b5 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51372025-07-18T00:04:01.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f629fcad-b8cb-4303-9f0c-b7d5e45440b5 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51382025-07-18T00:04:02.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 121c3d98-14cc-4aa8-be67-860520eacaa6 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51392025-07-18T00:04:02.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 121c3d98-14cc-4aa8-be67-860520eacaa6 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51402025-07-18T00:04:02.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 121c3d98-14cc-4aa8-be67-860520eacaa6 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51412025-07-18T00:04:03.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 52b1a0e3-0b23-4ed6-8c61-d3c56f219578 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51422025-07-18T00:04:03.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 52b1a0e3-0b23-4ed6-8c61-d3c56f219578 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51432025-07-18T00:04:03.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 52b1a0e3-0b23-4ed6-8c61-d3c56f219578 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51442025-07-18T00:04:04.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 55b88cc4-8b4d-4786-9344-e4f4eee82008 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51452025-07-18T00:04:04.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 55b88cc4-8b4d-4786-9344-e4f4eee82008 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51462025-07-18T00:04:04.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 55b88cc4-8b4d-4786-9344-e4f4eee82008 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51472025-07-18T00:04:05.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 148 reason = Timeout
51482025-07-18T00:04:05.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
51492025-07-18T00:04:05.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
51502025-07-18T00:04:05.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51512025-07-18T00:04:05.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
51522025-07-18T00:04:05.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
51532025-07-18T00:04:05.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
51542025-07-18T00:04:05.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
51552025-07-18T00:04:05.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.912717ms iteration = 148 status = {"chicken_switches_updated":false}
51562025-07-18T00:04:05.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 69433c7a-c05a-4ab2-b78e-e959cc301612 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51572025-07-18T00:04:05.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 69433c7a-c05a-4ab2-b78e-e959cc301612 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51582025-07-18T00:04:05.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 69433c7a-c05a-4ab2-b78e-e959cc301612 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51592025-07-18T00:04:06.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b8af2c70-4500-4a09-98bd-045a61525949 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51602025-07-18T00:04:06.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b8af2c70-4500-4a09-98bd-045a61525949 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51612025-07-18T00:04:06.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b8af2c70-4500-4a09-98bd-045a61525949 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51622025-07-18T00:04:07.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a6deb496-e07d-4977-893f-4689eb455280 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51632025-07-18T00:04:07.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a6deb496-e07d-4977-893f-4689eb455280 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51642025-07-18T00:04:07.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a6deb496-e07d-4977-893f-4689eb455280 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51652025-07-18T00:04:08.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8a36ee17-05b5-4399-8e90-d5fba31167a6 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51662025-07-18T00:04:08.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8a36ee17-05b5-4399-8e90-d5fba31167a6 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51672025-07-18T00:04:08.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8a36ee17-05b5-4399-8e90-d5fba31167a6 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51682025-07-18T00:04:09.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f24ae834-f1b1-44dc-ba48-fd732619ab36 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51692025-07-18T00:04:09.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f24ae834-f1b1-44dc-ba48-fd732619ab36 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51702025-07-18T00:04:09.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f24ae834-f1b1-44dc-ba48-fd732619ab36 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
51712025-07-18T00:04:10.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 149 reason = Timeout
51722025-07-18T00:04:10.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
51732025-07-18T00:04:10.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
51742025-07-18T00:04:10.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51752025-07-18T00:04:10.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
51762025-07-18T00:04:10.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
51772025-07-18T00:04:10.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
51782025-07-18T00:04:10.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
51792025-07-18T00:04:10.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
51802025-07-18T00:04:10.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51812025-07-18T00:04:10.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51822025-07-18T00:04:10.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51832025-07-18T00:04:10.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
51842025-07-18T00:04:10.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.324907ms iteration = 149 status = {"chicken_switches_updated":false}
51852025-07-18T00:04:10.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51862025-07-18T00:04:10.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51872025-07-18T00:04:10.218ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51882025-07-18T00:04:10.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51892025-07-18T00:04:10.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.672006ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51902025-07-18T00:04:10.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51912025-07-18T00:04:10.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51922025-07-18T00:04:10.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51932025-07-18T00:04:10.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51942025-07-18T00:04:10.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51952025-07-18T00:04:10.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51962025-07-18T00:04:10.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
51972025-07-18T00:04:10.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51982025-07-18T00:04:10.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51992025-07-18T00:04:10.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
52002025-07-18T00:04:10.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.12037ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
52012025-07-18T00:04:10.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c4810832-5549-451c-b60f-1c5aa6d97f21 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52022025-07-18T00:04:10.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c4810832-5549-451c-b60f-1c5aa6d97f21 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52032025-07-18T00:04:10.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c4810832-5549-451c-b60f-1c5aa6d97f21 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52042025-07-18T00:04:10.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 664 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = f7f2899e-d568-47df-8098-dceaf32ceda3 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
52052025-07-18T00:04:11.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = caac24ce-b062-4425-936c-b3cf5fed9c8b roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52062025-07-18T00:04:11.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = caac24ce-b062-4425-936c-b3cf5fed9c8b resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52072025-07-18T00:04:11.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = caac24ce-b062-4425-936c-b3cf5fed9c8b response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52082025-07-18T00:04:12.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 60475ae3-d1a2-4e07-95cc-53ee5781e197 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52092025-07-18T00:04:12.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 60475ae3-d1a2-4e07-95cc-53ee5781e197 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52102025-07-18T00:04:12.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 60475ae3-d1a2-4e07-95cc-53ee5781e197 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52112025-07-18T00:04:13.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 323fcaf2-63e2-41bd-b1e8-e343c7165679 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52122025-07-18T00:04:13.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 323fcaf2-63e2-41bd-b1e8-e343c7165679 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52132025-07-18T00:04:13.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 323fcaf2-63e2-41bd-b1e8-e343c7165679 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52142025-07-18T00:04:14.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8b5291f5-fc58-4ae2-8f64-15a849ae2f85 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52152025-07-18T00:04:14.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8b5291f5-fc58-4ae2-8f64-15a849ae2f85 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52162025-07-18T00:04:14.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8b5291f5-fc58-4ae2-8f64-15a849ae2f85 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52172025-07-18T00:04:15.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 150 reason = Timeout
52182025-07-18T00:04:15.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
52192025-07-18T00:04:15.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
52202025-07-18T00:04:15.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52212025-07-18T00:04:15.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
52222025-07-18T00:04:15.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
52232025-07-18T00:04:15.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
52242025-07-18T00:04:15.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
52252025-07-18T00:04:15.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.675973ms iteration = 150 status = {"chicken_switches_updated":false}
52262025-07-18T00:04:15.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 88e21fa6-2b6f-4359-8ada-97b5da4087ba roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52272025-07-18T00:04:15.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 88e21fa6-2b6f-4359-8ada-97b5da4087ba resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52282025-07-18T00:04:15.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 88e21fa6-2b6f-4359-8ada-97b5da4087ba response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52292025-07-18T00:04:17.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0099d2ed-5f39-4d71-a74e-e1bc9bc3be21 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52302025-07-18T00:04:17.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0099d2ed-5f39-4d71-a74e-e1bc9bc3be21 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52312025-07-18T00:04:17.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0099d2ed-5f39-4d71-a74e-e1bc9bc3be21 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52322025-07-18T00:04:18.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d9099bd6-f738-4ec3-b56f-625df4218625 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52332025-07-18T00:04:18.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d9099bd6-f738-4ec3-b56f-625df4218625 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52342025-07-18T00:04:18.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d9099bd6-f738-4ec3-b56f-625df4218625 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52352025-07-18T00:04:19.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e26cfbc8-dc43-4cee-9ed1-df9899e4e9bb roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52362025-07-18T00:04:19.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e26cfbc8-dc43-4cee-9ed1-df9899e4e9bb resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52372025-07-18T00:04:19.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e26cfbc8-dc43-4cee-9ed1-df9899e4e9bb response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52382025-07-18T00:04:20.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f0a1caf4-8477-42e7-a67f-3b4033389ec2 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52392025-07-18T00:04:20.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f0a1caf4-8477-42e7-a67f-3b4033389ec2 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52402025-07-18T00:04:20.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f0a1caf4-8477-42e7-a67f-3b4033389ec2 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
52412025-07-18T00:04:20.208ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
52422025-07-18T00:04:20.208ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
52432025-07-18T00:04:20.208ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
52442025-07-18T00:04:20.208ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52452025-07-18T00:04:20.208ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52462025-07-18T00:04:20.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52472025-07-18T00:04:20.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52482025-07-18T00:04:20.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 151 reason = Timeout
52492025-07-18T00:04:20.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
52502025-07-18T00:04:20.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1743, tv_nsec: 287586002 } })
52512025-07-18T00:04:20.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
52522025-07-18T00:04:20.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
52532025-07-18T00:04:20.210ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.296366ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52542025-07-18T00:04:20.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1743, tv_nsec: 288648319 } })
52552025-07-18T00:04:20.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
52562025-07-18T00:04:20.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52572025-07-18T00:04:20.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
52582025-07-18T00:04:20.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
52592025-07-18T00:04:20.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52602025-07-18T00:04:20.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52612025-07-18T00:04:20.215ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
52622025-07-18T00:04:20.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
52632025-07-18T00:04:20.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52642025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52652025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
52662025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
52672025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52682025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52692025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
52702025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52712025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52722025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
52732025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52742025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
52752025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52762025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
52772025-07-18T00:04:20.216ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52782025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52792025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
52802025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52812025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52822025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52832025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52842025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52852025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52862025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52872025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52882025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52892025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52902025-07-18T00:04:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52912025-07-18T00:04:20.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52922025-07-18T00:04:20.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
52932025-07-18T00:04:20.218ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
52942025-07-18T00:04:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
52952025-07-18T00:04:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
52962025-07-18T00:04:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
52972025-07-18T00:04:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52982025-07-18T00:04:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
52992025-07-18T00:04:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53002025-07-18T00:04:20.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
53012025-07-18T00:04:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53022025-07-18T00:04:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53032025-07-18T00:04:20.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53042025-07-18T00:04:20.220ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
53052025-07-18T00:04:20.220ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53062025-07-18T00:04:20.220ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
53072025-07-18T00:04:20.220ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
53082025-07-18T00:04:20.220ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 26 reason = Timeout
53092025-07-18T00:04:20.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53102025-07-18T00:04:20.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
53112025-07-18T00:04:20.220ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1743, tv_nsec: 298270827 } })
53122025-07-18T00:04:20.221ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53132025-07-18T00:04:20.221ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53142025-07-18T00:04:20.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53152025-07-18T00:04:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53162025-07-18T00:04:20.224ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53172025-07-18T00:04:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
53182025-07-18T00:04:20.224ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
53192025-07-18T00:04:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53202025-07-18T00:04:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
53212025-07-18T00:04:20.225ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53222025-07-18T00:04:20.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53232025-07-18T00:04:20.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53242025-07-18T00:04:20.226ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53252025-07-18T00:04:20.226ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53262025-07-18T00:04:20.226ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53272025-07-18T00:04:20.227ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53282025-07-18T00:04:20.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53292025-07-18T00:04:20.227ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53302025-07-18T00:04:20.228ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
53312025-07-18T00:04:20.228ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 18.342642ms iteration = 151 status = {"chicken_switches_updated":false}
53322025-07-18T00:04:20.228ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53332025-07-18T00:04:20.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53342025-07-18T00:04:20.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53352025-07-18T00:04:20.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53362025-07-18T00:04:20.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53372025-07-18T00:04:20.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53382025-07-18T00:04:20.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53392025-07-18T00:04:20.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53402025-07-18T00:04:20.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53412025-07-18T00:04:20.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53422025-07-18T00:04:20.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53432025-07-18T00:04:20.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53442025-07-18T00:04:20.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53452025-07-18T00:04:20.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53462025-07-18T00:04:20.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53472025-07-18T00:04:20.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53482025-07-18T00:04:20.239ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
53492025-07-18T00:04:20.239ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.626863ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
53502025-07-18T00:04:20.239ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 19.628443ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
53512025-07-18T00:04:20.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53522025-07-18T00:04:20.241ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
53532025-07-18T00:04:20.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53542025-07-18T00:04:20.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
53552025-07-18T00:04:20.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53562025-07-18T00:04:20.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53572025-07-18T00:04:20.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53582025-07-18T00:04:20.244ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53592025-07-18T00:04:20.244ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53602025-07-18T00:04:20.244ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53612025-07-18T00:04:20.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53622025-07-18T00:04:20.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53632025-07-18T00:04:20.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53642025-07-18T00:04:20.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53652025-07-18T00:04:20.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53662025-07-18T00:04:20.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53672025-07-18T00:04:20.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 27.26902ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53682025-07-18T00:04:20.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53692025-07-18T00:04:20.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53702025-07-18T00:04:20.247ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1743, tv_nsec: 324531991 } })
53712025-07-18T00:04:20.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53722025-07-18T00:04:20.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
53732025-07-18T00:04:20.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53742025-07-18T00:04:20.248ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53752025-07-18T00:04:20.248ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53762025-07-18T00:04:20.248ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 32.527921ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
53772025-07-18T00:04:20.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
53782025-07-18T00:04:20.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53792025-07-18T00:04:20.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53802025-07-18T00:04:20.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53812025-07-18T00:04:20.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53822025-07-18T00:04:20.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53832025-07-18T00:04:20.276ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
53842025-07-18T00:04:20.278ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.657304ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
53852025-07-18T00:04:20.297ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53862025-07-18T00:04:20.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53872025-07-18T00:04:20.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.075816ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53882025-07-18T00:04:20.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 89.188823ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
53892025-07-18T00:04:20.312ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53902025-07-18T00:04:20.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 94.064579ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
53912025-07-18T00:04:20.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53922025-07-18T00:04:20.314ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53932025-07-18T00:04:20.314ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53942025-07-18T00:04:20.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53952025-07-18T00:04:20.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53962025-07-18T00:04:20.317ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 98.514906ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
53972025-07-18T00:04:20.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53982025-07-18T00:04:20.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
53992025-07-18T00:04:20.317ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
54002025-07-18T00:04:20.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
54012025-07-18T00:04:20.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 103.362351ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54022025-07-18T00:04:20.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54032025-07-18T00:04:20.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54042025-07-18T00:04:20.327ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
54052025-07-18T00:04:20.327ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "39964072-4b04-4c8b-a737-3d228e790b06", "content-length": "78", "date": "Fri, 18 Jul 2025 00:04:20 GMT"} })
54062025-07-18T00:04:20.327ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
54072025-07-18T00:04:20.327ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
54082025-07-18T00:04:20.327ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
54092025-07-18T00:04:20.327ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54102025-07-18T00:04:20.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
54112025-07-18T00:04:20.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
54122025-07-18T00:04:20.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
54132025-07-18T00:04:20.329ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
54142025-07-18T00:04:20.329ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54152025-07-18T00:04:20.330ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f1de9f2-7706-4d77-9058-49d90e879b0e", "content-length": "26", "date": "Fri, 18 Jul 2025 00:04:20 GMT"} })
54162025-07-18T00:04:20.330ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54172025-07-18T00:04:20.330ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
54182025-07-18T00:04:20.330ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
54192025-07-18T00:04:20.330ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
54202025-07-18T00:04:20.331ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54212025-07-18T00:04:20.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, lookup_type: ById(4a597d98-bd6a-42be-a09e-71b1fbba6de5) } result = Ok(())
54222025-07-18T00:04:20.332ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54232025-07-18T00:04:20.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54242025-07-18T00:04:20.333ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
54252025-07-18T00:04:20.333ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
54262025-07-18T00:04:20.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
54272025-07-18T00:04:20.333ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
54282025-07-18T00:04:20.333ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
54292025-07-18T00:04:20.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
54302025-07-18T00:04:20.334ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
54312025-07-18T00:04:20.334ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
54322025-07-18T00:04:20.334ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
54332025-07-18T00:04:20.334ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
54342025-07-18T00:04:20.334ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.978971ms iteration = 26 status = 0
54352025-07-18T00:04:20.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
54362025-07-18T00:04:20.335ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "39eb34d4-fb72-4090-bb97-7979c8a3d9ed", "content-length": "81", "date": "Fri, 18 Jul 2025 00:04:20 GMT"} })
54372025-07-18T00:04:20.350ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 zone_address = fd00:1122:3344:101::2
54382025-07-18T00:04:20.350ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54392025-07-18T00:04:20.351ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c47583f4-5b88-4e6b-9ae5-df2b6cb430fe", "content-length": "26", "date": "Fri, 18 Jul 2025 00:04:20 GMT"} })
54402025-07-18T00:04:20.351ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54412025-07-18T00:04:20.352ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
54422025-07-18T00:04:20.361ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
54432025-07-18T00:04:20.361ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54442025-07-18T00:04:20.362ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76242ad1-f6b2-4361-ae46-02a9b6349edb", "content-length": "26", "date": "Fri, 18 Jul 2025 00:04:20 GMT"} })
54452025-07-18T00:04:20.362ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54462025-07-18T00:04:20.363ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54472025-07-18T00:04:20.369ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:389
54482025-07-18T00:04:20.369ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 153.543474ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
54492025-07-18T00:04:20.373ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
54502025-07-18T00:04:20.373ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
54512025-07-18T00:04:20.373ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c8ab8ed-88b3-48d4-a907-594703b39b78", "content-length": "81", "date": "Fri, 18 Jul 2025 00:04:20 GMT"} })
54522025-07-18T00:04:20.374ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
54532025-07-18T00:04:20.374ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
54542025-07-18T00:04:20.375ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "7419cd75-6706-4e11-b895-02d1a6c8ee09", "content-length": "81", "date": "Fri, 18 Jul 2025 00:04:20 GMT"} })
54552025-07-18T00:04:20.376ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 156.264496ms iteration = 26 status = {"errors":[],"sps":[]}
54562025-07-18T00:04:20.418ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54572025-07-18T00:04:20.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54582025-07-18T00:04:20.444ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54592025-07-18T00:04:20.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54602025-07-18T00:04:20.446ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 230.704692ms iteration = 29 status = {"physical_disks_added":0}
54612025-07-18T00:04:20.447ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 239.437177ms iteration = 26 status = null
54622025-07-18T00:04:20.485ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 277.150337ms iteration = 26 status = {}
54632025-07-18T00:04:20.524ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54642025-07-18T00:04:20.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54652025-07-18T00:04:20.525ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54662025-07-18T00:04:20.528ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54672025-07-18T00:04:20.528ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54682025-07-18T00:04:20.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54692025-07-18T00:04:20.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54702025-07-18T00:04:20.533ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54712025-07-18T00:04:20.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54722025-07-18T00:04:20.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54732025-07-18T00:04:20.563ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54742025-07-18T00:04:20.563ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54752025-07-18T00:04:20.564ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e37c5eb2-ed1d-4974-a081-6d4a24fc5346", "content-length": "372", "date": "Fri, 18 Jul 2025 00:04:20 GMT"} })
54762025-07-18T00:04:20.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54772025-07-18T00:04:20.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54782025-07-18T00:04:20.586ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
54792025-07-18T00:04:20.586ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54802025-07-18T00:04:20.587ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "aa815ae8-d898-4bad-89a8-8ee1ff63545d", "date": "Fri, 18 Jul 2025 00:04:20 GMT"} })
54812025-07-18T00:04:20.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54822025-07-18T00:04:20.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54832025-07-18T00:04:20.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54842025-07-18T00:04:20.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54852025-07-18T00:04:20.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54862025-07-18T00:04:20.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54872025-07-18T00:04:20.597ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54882025-07-18T00:04:20.597ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54892025-07-18T00:04:20.598ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c09e1687-086f-4e03-8b29-0c6f992d7507", "date": "Fri, 18 Jul 2025 00:04:20 GMT"} })
54902025-07-18T00:04:20.599ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 383.87291ms iteration = 27 status = {}
54912025-07-18T00:04:20.609ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54922025-07-18T00:04:20.610ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c67f2606-1e4e-4663-a6af-3addce428f00", "content-length": "691", "date": "Fri, 18 Jul 2025 00:04:20 GMT"} })
54932025-07-18T00:04:20.610ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
54942025-07-18T00:04:20.610ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
54952025-07-18T00:04:20.610ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
54962025-07-18T00:04:20.611ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 395.58492ms iteration = 27 status = {}
54972025-07-18T00:04:20.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54982025-07-18T00:04:20.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54992025-07-18T00:04:20.641ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a2d734dc-e0c9-4fd6-b442-f2c4e63791e5, rack_id: e4e73d6b-d53c-414c-93a8-eff1ed3c4807, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(9d790dba-5335-4b4c-be2a-58416dc1e8f5) } rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
55002025-07-18T00:04:20.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55012025-07-18T00:04:20.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55022025-07-18T00:04:20.656ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
55032025-07-18T00:04:20.656ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 9d790dba-5335-4b4c-be2a-58416dc1e8f5
55042025-07-18T00:04:20.656ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55052025-07-18T00:04:20.656ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55062025-07-18T00:04:20.656ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55072025-07-18T00:04:20.656ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55082025-07-18T00:04:20.656ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55092025-07-18T00:04:20.656ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55102025-07-18T00:04:20.656ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55112025-07-18T00:04:20.656ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55122025-07-18T00:04:20.656ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
55132025-07-18T00:04:20.656ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55142025-07-18T00:04:20.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55152025-07-18T00:04:20.659ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
55162025-07-18T00:04:20.659ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55172025-07-18T00:04:20.769ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ee3dbcec-36b2-4d67-abbf-dbf3f014787e", "date": "Fri, 18 Jul 2025 00:04:20 GMT"} })
55182025-07-18T00:04:20.770ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch = Switch0
55192025-07-18T00:04:20.770ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55202025-07-18T00:04:20.770ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d69e03f2-85f6-440b-a186-68e9ad4cbb33", "content-length": "682", "date": "Fri, 18 Jul 2025 00:04:20 GMT"} })
55212025-07-18T00:04:20.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55222025-07-18T00:04:20.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55232025-07-18T00:04:20.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55242025-07-18T00:04:20.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55252025-07-18T00:04:20.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55262025-07-18T00:04:20.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55272025-07-18T00:04:20.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55282025-07-18T00:04:20.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55292025-07-18T00:04:20.787ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 571.691412ms iteration = 26 status = {}
55302025-07-18T00:04:20.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 636 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = cd0b5137-df65-4dc0-9a47-fff03ba83e03 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
55312025-07-18T00:04:21.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b85e1f53-1684-4679-a661-79fda3431182 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55322025-07-18T00:04:21.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b85e1f53-1684-4679-a661-79fda3431182 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55332025-07-18T00:04:21.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b85e1f53-1684-4679-a661-79fda3431182 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55342025-07-18T00:04:22.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f022b955-32f3-4af1-8fa2-84cc3024c4d0 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55352025-07-18T00:04:22.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f022b955-32f3-4af1-8fa2-84cc3024c4d0 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55362025-07-18T00:04:22.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f022b955-32f3-4af1-8fa2-84cc3024c4d0 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55372025-07-18T00:04:23.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c6c2016a-d929-47ed-9428-058900fa841b roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55382025-07-18T00:04:23.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c6c2016a-d929-47ed-9428-058900fa841b resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55392025-07-18T00:04:23.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c6c2016a-d929-47ed-9428-058900fa841b response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55402025-07-18T00:04:24.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a4327a4d-f737-4880-aca0-db825108aed3 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55412025-07-18T00:04:24.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a4327a4d-f737-4880-aca0-db825108aed3 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55422025-07-18T00:04:24.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a4327a4d-f737-4880-aca0-db825108aed3 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55432025-07-18T00:04:25.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bc5a6872-a3bd-4e19-83a7-4cd070a5b04e roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55442025-07-18T00:04:25.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bc5a6872-a3bd-4e19-83a7-4cd070a5b04e resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55452025-07-18T00:04:25.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bc5a6872-a3bd-4e19-83a7-4cd070a5b04e response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55462025-07-18T00:04:25.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 152 reason = Timeout
55472025-07-18T00:04:25.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
55482025-07-18T00:04:25.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
55492025-07-18T00:04:25.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55502025-07-18T00:04:25.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
55512025-07-18T00:04:25.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
55522025-07-18T00:04:25.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
55532025-07-18T00:04:25.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
55542025-07-18T00:04:25.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.415574ms iteration = 152 status = {"chicken_switches_updated":false}
55552025-07-18T00:04:26.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 065f0884-3044-4f33-abae-4a251c5ffa5d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55562025-07-18T00:04:26.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 065f0884-3044-4f33-abae-4a251c5ffa5d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55572025-07-18T00:04:26.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 065f0884-3044-4f33-abae-4a251c5ffa5d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55582025-07-18T00:04:27.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f96003da-f0e8-4524-aff9-6220867a84da roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55592025-07-18T00:04:27.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f96003da-f0e8-4524-aff9-6220867a84da resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55602025-07-18T00:04:27.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f96003da-f0e8-4524-aff9-6220867a84da response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55612025-07-18T00:04:28.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 53c83a25-864b-4898-b54c-8292da86c72d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55622025-07-18T00:04:28.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 53c83a25-864b-4898-b54c-8292da86c72d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55632025-07-18T00:04:28.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 53c83a25-864b-4898-b54c-8292da86c72d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55642025-07-18T00:04:29.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 92a21274-a1c6-4250-9ba2-308b7d881328 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55652025-07-18T00:04:29.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 92a21274-a1c6-4250-9ba2-308b7d881328 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55662025-07-18T00:04:29.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 92a21274-a1c6-4250-9ba2-308b7d881328 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55672025-07-18T00:04:30.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 153 reason = Timeout
55682025-07-18T00:04:30.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
55692025-07-18T00:04:30.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
55702025-07-18T00:04:30.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55712025-07-18T00:04:30.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
55722025-07-18T00:04:30.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
55732025-07-18T00:04:30.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
55742025-07-18T00:04:30.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
55752025-07-18T00:04:30.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
55762025-07-18T00:04:30.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55772025-07-18T00:04:30.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55782025-07-18T00:04:30.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55792025-07-18T00:04:30.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55802025-07-18T00:04:30.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
55812025-07-18T00:04:30.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.729773ms iteration = 153 status = {"chicken_switches_updated":false}
55822025-07-18T00:04:30.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55832025-07-18T00:04:30.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55842025-07-18T00:04:30.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55852025-07-18T00:04:30.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = fae8229c-638f-45a0-ab8f-c01f2f49a607 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55862025-07-18T00:04:30.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = fae8229c-638f-45a0-ab8f-c01f2f49a607 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55872025-07-18T00:04:30.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.107213ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55882025-07-18T00:04:30.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55892025-07-18T00:04:30.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55902025-07-18T00:04:30.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55912025-07-18T00:04:30.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = fae8229c-638f-45a0-ab8f-c01f2f49a607 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
55922025-07-18T00:04:30.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55932025-07-18T00:04:30.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55942025-07-18T00:04:30.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55952025-07-18T00:04:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
55962025-07-18T00:04:30.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55972025-07-18T00:04:30.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55982025-07-18T00:04:30.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
55992025-07-18T00:04:30.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.899747ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
56002025-07-18T00:04:30.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 603 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = d3fa3d3b-e51a-42d8-a5e0-704c4c5c955e response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
56012025-07-18T00:04:31.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b4c689ec-fcc0-48a1-b87d-9720acc154cb roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56022025-07-18T00:04:31.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b4c689ec-fcc0-48a1-b87d-9720acc154cb resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56032025-07-18T00:04:31.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b4c689ec-fcc0-48a1-b87d-9720acc154cb response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56042025-07-18T00:04:32.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e695c950-4c71-4390-81c3-535b606d8b0c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56052025-07-18T00:04:32.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e695c950-4c71-4390-81c3-535b606d8b0c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56062025-07-18T00:04:32.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e695c950-4c71-4390-81c3-535b606d8b0c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56072025-07-18T00:04:33.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = cc4eecdb-9cea-41fb-b454-d33d470e7db2 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56082025-07-18T00:04:33.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = cc4eecdb-9cea-41fb-b454-d33d470e7db2 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56092025-07-18T00:04:33.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = cc4eecdb-9cea-41fb-b454-d33d470e7db2 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56102025-07-18T00:04:34.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a7b52d78-8b48-4797-bccf-f133a54be34a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56112025-07-18T00:04:34.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a7b52d78-8b48-4797-bccf-f133a54be34a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56122025-07-18T00:04:34.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a7b52d78-8b48-4797-bccf-f133a54be34a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56132025-07-18T00:04:35.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 154 reason = Timeout
56142025-07-18T00:04:35.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
56152025-07-18T00:04:35.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
56162025-07-18T00:04:35.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56172025-07-18T00:04:35.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
56182025-07-18T00:04:35.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
56192025-07-18T00:04:35.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
56202025-07-18T00:04:35.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
56212025-07-18T00:04:35.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.115864ms iteration = 154 status = {"chicken_switches_updated":false}
56222025-07-18T00:04:35.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d3c6ecb8-8670-4830-9ad6-56b820624884 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56232025-07-18T00:04:35.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d3c6ecb8-8670-4830-9ad6-56b820624884 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56242025-07-18T00:04:35.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d3c6ecb8-8670-4830-9ad6-56b820624884 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56252025-07-18T00:04:36.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 13bc439b-93e5-4481-acfe-e7b87ebd63dc roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56262025-07-18T00:04:36.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 13bc439b-93e5-4481-acfe-e7b87ebd63dc resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56272025-07-18T00:04:36.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 13bc439b-93e5-4481-acfe-e7b87ebd63dc response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56282025-07-18T00:04:37.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3cacc153-74c0-4e5c-b149-5b26ee21ac23 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56292025-07-18T00:04:37.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3cacc153-74c0-4e5c-b149-5b26ee21ac23 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56302025-07-18T00:04:37.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3cacc153-74c0-4e5c-b149-5b26ee21ac23 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56312025-07-18T00:04:38.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 98b566ad-cf03-4131-93e5-bf915726d9d8 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56322025-07-18T00:04:38.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 98b566ad-cf03-4131-93e5-bf915726d9d8 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56332025-07-18T00:04:38.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 98b566ad-cf03-4131-93e5-bf915726d9d8 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56342025-07-18T00:04:39.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d1409639-7c2b-40ac-a936-65279d4bd7b5 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56352025-07-18T00:04:39.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d1409639-7c2b-40ac-a936-65279d4bd7b5 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56362025-07-18T00:04:39.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d1409639-7c2b-40ac-a936-65279d4bd7b5 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56372025-07-18T00:04:40.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 155 reason = Timeout
56382025-07-18T00:04:40.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
56392025-07-18T00:04:40.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
56402025-07-18T00:04:40.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56412025-07-18T00:04:40.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
56422025-07-18T00:04:40.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
56432025-07-18T00:04:40.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
56442025-07-18T00:04:40.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
56452025-07-18T00:04:40.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
56462025-07-18T00:04:40.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56472025-07-18T00:04:40.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56482025-07-18T00:04:40.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56492025-07-18T00:04:40.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
56502025-07-18T00:04:40.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56512025-07-18T00:04:40.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.102604ms iteration = 155 status = {"chicken_switches_updated":false}
56522025-07-18T00:04:40.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56532025-07-18T00:04:40.218ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56542025-07-18T00:04:40.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56552025-07-18T00:04:40.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.614906ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56562025-07-18T00:04:40.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56572025-07-18T00:04:40.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56582025-07-18T00:04:40.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56592025-07-18T00:04:40.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56602025-07-18T00:04:40.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56612025-07-18T00:04:40.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56622025-07-18T00:04:40.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
56632025-07-18T00:04:40.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56642025-07-18T00:04:40.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56652025-07-18T00:04:40.239ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
56662025-07-18T00:04:40.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.652434ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
56672025-07-18T00:04:40.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c21cd0c3-331d-4054-8464-9a936aa570cc roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56682025-07-18T00:04:40.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c21cd0c3-331d-4054-8464-9a936aa570cc resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56692025-07-18T00:04:40.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c21cd0c3-331d-4054-8464-9a936aa570cc response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56702025-07-18T00:04:40.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 920 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = d51ee0e7-5765-4d90-bc2b-b9cfbadd715b response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
56712025-07-18T00:04:41.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4613cda6-3d49-4f42-8427-6873fc5e32ba roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56722025-07-18T00:04:41.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4613cda6-3d49-4f42-8427-6873fc5e32ba resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56732025-07-18T00:04:41.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4613cda6-3d49-4f42-8427-6873fc5e32ba response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56742025-07-18T00:04:42.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7930a76a-4871-49d6-a051-0fa3e144c823 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56752025-07-18T00:04:42.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7930a76a-4871-49d6-a051-0fa3e144c823 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56762025-07-18T00:04:42.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7930a76a-4871-49d6-a051-0fa3e144c823 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56772025-07-18T00:04:43.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3a4f4e00-0d26-486a-9d64-443dc1eb0814 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56782025-07-18T00:04:43.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3a4f4e00-0d26-486a-9d64-443dc1eb0814 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56792025-07-18T00:04:43.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3a4f4e00-0d26-486a-9d64-443dc1eb0814 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56802025-07-18T00:04:44.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4aaa81da-9028-40b6-b231-ffbe3529b134 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56812025-07-18T00:04:44.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4aaa81da-9028-40b6-b231-ffbe3529b134 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56822025-07-18T00:04:44.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4aaa81da-9028-40b6-b231-ffbe3529b134 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56832025-07-18T00:04:45.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 156 reason = Timeout
56842025-07-18T00:04:45.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
56852025-07-18T00:04:45.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
56862025-07-18T00:04:45.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56872025-07-18T00:04:45.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
56882025-07-18T00:04:45.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
56892025-07-18T00:04:45.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
56902025-07-18T00:04:45.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
56912025-07-18T00:04:45.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.340978ms iteration = 156 status = {"chicken_switches_updated":false}
56922025-07-18T00:04:45.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 87b2e23f-68ef-4d85-962a-75168e941ed7 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56932025-07-18T00:04:45.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 87b2e23f-68ef-4d85-962a-75168e941ed7 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56942025-07-18T00:04:45.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 87b2e23f-68ef-4d85-962a-75168e941ed7 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56952025-07-18T00:04:46.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c62dfaee-afe2-423e-ade1-805c093c7d11 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56962025-07-18T00:04:46.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c62dfaee-afe2-423e-ade1-805c093c7d11 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56972025-07-18T00:04:46.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c62dfaee-afe2-423e-ade1-805c093c7d11 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56982025-07-18T00:04:47.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = de0b3772-bf99-458d-b1b4-5ecce27dc1f6 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
56992025-07-18T00:04:47.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = de0b3772-bf99-458d-b1b4-5ecce27dc1f6 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
57002025-07-18T00:04:47.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = de0b3772-bf99-458d-b1b4-5ecce27dc1f6 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
57012025-07-18T00:04:48.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c600d21a-25ac-467d-8f49-a3715e8be02f roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
57022025-07-18T00:04:48.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c600d21a-25ac-467d-8f49-a3715e8be02f resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
57032025-07-18T00:04:48.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = c600d21a-25ac-467d-8f49-a3715e8be02f response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
57042025-07-18T00:04:49.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2c0e5b5a-d263-4f47-9f9f-9c7c18f571a3 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
57052025-07-18T00:04:49.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2c0e5b5a-d263-4f47-9f9f-9c7c18f571a3 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
57062025-07-18T00:04:49.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2766 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2c0e5b5a-d263-4f47-9f9f-9c7c18f571a3 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
57072025-07-18T00:04:50.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
57082025-07-18T00:04:50.206ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
57092025-07-18T00:04:50.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57102025-07-18T00:04:50.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57112025-07-18T00:04:50.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57122025-07-18T00:04:50.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57132025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
57142025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
57152025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
57162025-07-18T00:04:50.208ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-17 23:54:50.208755033 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
57172025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
57182025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
57192025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
57202025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57212025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
57222025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
57232025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57242025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
57252025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57262025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
57272025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
57282025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
57292025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57302025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57312025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
57322025-07-18T00:04:50.208ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 9092da00-a622-42cf-99af-453ea64d4a35
57332025-07-18T00:04:50.208ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.061\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"9092da00-a622-42cf-99af-453ea64d4a35"}
57342025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
57352025-07-18T00:04:50.209ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("56b8d8b3-74d8-49ff-9bba-ff575bfeff38.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b6789fb-7f6d-466d-9e8d-08234eb15cb4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eee78e3b-9d92-4bbf-a496-9511487338e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("eee78e3b-9d92-4bbf-a496-9511487338e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:3::1)) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 286322493 } })
57362025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57372025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57382025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57392025-07-18T00:04:50.209ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("464a3447-fe1f-417e-b585-925f5fb5bfdc.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da3261f0-45ba-4fbf-b6bb-a5a70850db80.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("da3261f0-45ba-4fbf-b6bb-a5a70850db80.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 286418564 } })
57402025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57412025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 18 reason = Timeout
57422025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
57432025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 157 reason = Timeout
57442025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 11.81\u{b5}s iteration = 18 status = "Disabled"
57452025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
57462025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
57472025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.159748ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
57482025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
57492025-07-18T00:04:50.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.176748ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
57502025-07-18T00:04:50.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
57512025-07-18T00:04:50.211ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-17 23:54:50.208755033 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
57522025-07-18T00:04:50.211ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.832723ms iteration = 14 status = {"expiration":"2025-07-17T23:54:50.208755033Z","pruned":[]}
57532025-07-18T00:04:50.211ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57542025-07-18T00:04:50.211ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57552025-07-18T00:04:50.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57562025-07-18T00:04:50.212ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 289300349 } })
57572025-07-18T00:04:50.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57582025-07-18T00:04:50.212ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
57592025-07-18T00:04:50.213ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 290308524 } })
57602025-07-18T00:04:50.213ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.438698ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57612025-07-18T00:04:50.213ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57622025-07-18T00:04:50.213ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
57632025-07-18T00:04:50.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57642025-07-18T00:04:50.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57652025-07-18T00:04:50.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57662025-07-18T00:04:50.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57672025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
57682025-07-18T00:04:50.216ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
57692025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
57702025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
57712025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57722025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57732025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57742025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
57752025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
57762025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57772025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57782025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
57792025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57802025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
57812025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57822025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
57832025-07-18T00:04:50.216ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57842025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57852025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
57862025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
57872025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
57882025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57892025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
57902025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57912025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
57922025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57932025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
57942025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57952025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
57962025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57972025-07-18T00:04:50.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57982025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57992025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58002025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58012025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58022025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58032025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58042025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58052025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58062025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58072025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
58082025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58092025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58102025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58112025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58122025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
58132025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
58142025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
58152025-07-18T00:04:50.217ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58162025-07-18T00:04:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58172025-07-18T00:04:50.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58182025-07-18T00:04:50.219ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
58192025-07-18T00:04:50.219ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
58202025-07-18T00:04:50.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
58212025-07-18T00:04:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58222025-07-18T00:04:50.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
58232025-07-18T00:04:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58242025-07-18T00:04:50.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
58252025-07-18T00:04:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58262025-07-18T00:04:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58272025-07-18T00:04:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58282025-07-18T00:04:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58292025-07-18T00:04:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
58302025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 14 reason = Timeout
58312025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
58322025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
58332025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
58342025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 14 reason = Timeout
58352025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
58362025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
58372025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58382025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 27 reason = Timeout
58392025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
58402025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58412025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
58422025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
58432025-07-18T00:04:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58442025-07-18T00:04:50.221ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 298082934 } })
58452025-07-18T00:04:50.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58462025-07-18T00:04:50.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58472025-07-18T00:04:50.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58482025-07-18T00:04:50.225ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58492025-07-18T00:04:50.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58502025-07-18T00:04:50.227ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58512025-07-18T00:04:50.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58522025-07-18T00:04:50.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58532025-07-18T00:04:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58542025-07-18T00:04:50.228ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58552025-07-18T00:04:50.229ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58562025-07-18T00:04:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58572025-07-18T00:04:50.229ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
58582025-07-18T00:04:50.229ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 19.345948ms iteration = 157 status = {"chicken_switches_updated":false}
58592025-07-18T00:04:50.230ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58602025-07-18T00:04:50.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58612025-07-18T00:04:50.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58622025-07-18T00:04:50.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
58632025-07-18T00:04:50.232ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58642025-07-18T00:04:50.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58652025-07-18T00:04:50.232ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58662025-07-18T00:04:50.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58672025-07-18T00:04:50.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58682025-07-18T00:04:50.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58692025-07-18T00:04:50.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58702025-07-18T00:04:50.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58712025-07-18T00:04:50.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58722025-07-18T00:04:50.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58732025-07-18T00:04:50.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58742025-07-18T00:04:50.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
58752025-07-18T00:04:50.234ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58762025-07-18T00:04:50.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58772025-07-18T00:04:50.235ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58782025-07-18T00:04:50.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58792025-07-18T00:04:50.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
58802025-07-18T00:04:50.236ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58812025-07-18T00:04:50.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58822025-07-18T00:04:50.237ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.995497ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
58832025-07-18T00:04:50.237ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
58842025-07-18T00:04:50.237ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 17.130823ms iteration = 14 status = {"by_rx":{},"error":null}
58852025-07-18T00:04:50.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58862025-07-18T00:04:50.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58872025-07-18T00:04:50.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58882025-07-18T00:04:50.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58892025-07-18T00:04:50.243ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 22.931533ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
58902025-07-18T00:04:50.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 320502169 } })
58912025-07-18T00:04:50.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58922025-07-18T00:04:50.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
58932025-07-18T00:04:50.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58942025-07-18T00:04:50.245ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58952025-07-18T00:04:50.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58962025-07-18T00:04:50.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 26.810103ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58972025-07-18T00:04:50.250ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
58982025-07-18T00:04:50.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
58992025-07-18T00:04:50.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59002025-07-18T00:04:50.256ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59012025-07-18T00:04:50.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
59022025-07-18T00:04:50.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59032025-07-18T00:04:50.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59042025-07-18T00:04:50.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
59052025-07-18T00:04:50.260ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59062025-07-18T00:04:50.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59072025-07-18T00:04:50.270ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 48.06157ms iteration = 14 status = {"dispatched":[],"errors":[],"glob_version":"165.0.0","globs_reprocessed":{},"no_receivers":[]}
59082025-07-18T00:04:50.297ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
59092025-07-18T00:04:50.297ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
59102025-07-18T00:04:50.297ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
59112025-07-18T00:04:50.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59122025-07-18T00:04:50.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59132025-07-18T00:04:50.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59142025-07-18T00:04:50.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59152025-07-18T00:04:50.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59162025-07-18T00:04:50.307ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:389
59172025-07-18T00:04:50.307ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 90.042756ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
59182025-07-18T00:04:50.307ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59192025-07-18T00:04:50.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59202025-07-18T00:04:50.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59212025-07-18T00:04:50.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59222025-07-18T00:04:50.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59232025-07-18T00:04:50.308ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
59242025-07-18T00:04:50.308ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.604311ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
59252025-07-18T00:04:50.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59262025-07-18T00:04:50.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 92.046767ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59272025-07-18T00:04:50.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59282025-07-18T00:04:50.311ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
59292025-07-18T00:04:50.311ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
59302025-07-18T00:04:50.311ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
59312025-07-18T00:04:50.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59322025-07-18T00:04:50.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59332025-07-18T00:04:50.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 91.799473ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
59342025-07-18T00:04:50.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.964338ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59352025-07-18T00:04:50.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59362025-07-18T00:04:50.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59372025-07-18T00:04:50.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59382025-07-18T00:04:50.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59392025-07-18T00:04:50.314ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59402025-07-18T00:04:50.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59412025-07-18T00:04:50.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 95.367918ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
59422025-07-18T00:04:50.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59432025-07-18T00:04:50.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59442025-07-18T00:04:50.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59452025-07-18T00:04:50.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59462025-07-18T00:04:50.319ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
59472025-07-18T00:04:50.319ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
59482025-07-18T00:04:50.319ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.27876ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
59492025-07-18T00:04:50.320ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
59502025-07-18T00:04:50.320ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
59512025-07-18T00:04:50.320ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 104.184984ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
59522025-07-18T00:04:50.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59532025-07-18T00:04:50.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59542025-07-18T00:04:50.321ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
59552025-07-18T00:04:50.321ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a5c2ae61-5a10-495b-8726-f2f7ed24b4a0 dns_zone_name = oxide.test found_so_far = 0 version = 2
59562025-07-18T00:04:50.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59572025-07-18T00:04:50.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59582025-07-18T00:04:50.322ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59592025-07-18T00:04:50.322ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.218855ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59602025-07-18T00:04:50.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59612025-07-18T00:04:50.323ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59622025-07-18T00:04:50.324ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59632025-07-18T00:04:50.326ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59642025-07-18T00:04:50.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59652025-07-18T00:04:50.326ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59662025-07-18T00:04:50.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59672025-07-18T00:04:50.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59682025-07-18T00:04:50.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59692025-07-18T00:04:50.328ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59702025-07-18T00:04:50.328ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59712025-07-18T00:04:50.328ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59722025-07-18T00:04:50.328ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59732025-07-18T00:04:50.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59742025-07-18T00:04:50.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59752025-07-18T00:04:50.329ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59762025-07-18T00:04:50.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59772025-07-18T00:04:50.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59782025-07-18T00:04:50.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59792025-07-18T00:04:50.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59802025-07-18T00:04:50.332ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59812025-07-18T00:04:50.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59822025-07-18T00:04:50.333ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a5c2ae61-5a10-495b-8726-f2f7ed24b4a0 dns_zone_name = oxide.test found_so_far = 4 version = 2
59832025-07-18T00:04:50.333ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
59842025-07-18T00:04:50.333ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-17 23:52:11.153706 UTC dns_group = external generation = 2
59852025-07-18T00:04:50.333ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 124.348624ms iteration = 14 status = {"generation":2}
59862025-07-18T00:04:50.334ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59872025-07-18T00:04:50.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, lookup_type: ById(4a597d98-bd6a-42be-a09e-71b1fbba6de5) } result = Ok(())
59882025-07-18T00:04:50.338ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59892025-07-18T00:04:50.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59902025-07-18T00:04:50.338ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 122.164691ms iteration = 30 status = {"physical_disks_added":0}
59912025-07-18T00:04:50.341ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 124.522277ms iteration = 27 status = 0
59922025-07-18T00:04:50.373ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
59932025-07-18T00:04:50.373ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2be4d985-6e68-40d2-a5d1-ba1e291e5f99 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
59942025-07-18T00:04:50.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59952025-07-18T00:04:50.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59962025-07-18T00:04:50.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59972025-07-18T00:04:50.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59982025-07-18T00:04:50.379ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59992025-07-18T00:04:50.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60002025-07-18T00:04:50.382ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2be4d985-6e68-40d2-a5d1-ba1e291e5f99 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
60012025-07-18T00:04:50.382ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
60022025-07-18T00:04:50.382ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-17 23:52:10.609253 UTC dns_group = internal generation = 1
60032025-07-18T00:04:50.382ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 176.491357ms iteration = 14 status = {"generation":1}
60042025-07-18T00:04:50.387ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60052025-07-18T00:04:50.387ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
60062025-07-18T00:04:50.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60072025-07-18T00:04:50.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60082025-07-18T00:04:50.388ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 169.343317ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
60092025-07-18T00:04:50.393ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-17T23:51:46.880014Z, time_modified: 2025-07-17T23:51:46.880014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f37123ec-61ff-4793-867b-6920b7f6246a, db_silo: Silo { identity: SiloIdentity { id: f37123ec-61ff-4793-867b-6920b7f6246a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-17T23:52:11.102986Z, time_modified: 2025-07-17T23:52:11.102986Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f37123ec-61ff-4793-867b-6920b7f6246a, db_silo: Silo { identity: SiloIdentity { id: f37123ec-61ff-4793-867b-6920b7f6246a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-17T23:52:11.102986Z, time_modified: 2025-07-17T23:52:11.102986Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3" }] }) }
60102025-07-18T00:04:50.393ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 184.519421ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f37123ec-61ff-4793-867b-6920b7f6246a","tls_certs":["6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3"]}},"default_endpoint":{"silo_id":"f37123ec-61ff-4793-867b-6920b7f6246a","tls_certs":["6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
60112025-07-18T00:04:50.411ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
60122025-07-18T00:04:50.412ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60132025-07-18T00:04:50.412ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97f4719b-b174-407a-81c4-60dbb5e4f82d", "content-length": "26", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} })
60142025-07-18T00:04:50.412ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60152025-07-18T00:04:50.413ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
60162025-07-18T00:04:50.414ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60172025-07-18T00:04:50.416ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
60182025-07-18T00:04:50.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60192025-07-18T00:04:50.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60202025-07-18T00:04:50.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60212025-07-18T00:04:50.435ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
60222025-07-18T00:04:50.436ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "f16609e2-3713-441e-b1e6-358dfbc91854", "content-length": "78", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} })
60232025-07-18T00:04:50.436ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
60242025-07-18T00:04:50.436ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
60252025-07-18T00:04:50.436ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
60262025-07-18T00:04:50.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
60272025-07-18T00:04:50.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
60282025-07-18T00:04:50.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
60292025-07-18T00:04:50.439ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
60302025-07-18T00:04:50.439ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
60312025-07-18T00:04:50.440ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
60322025-07-18T00:04:50.444ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
60332025-07-18T00:04:50.444ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
60342025-07-18T00:04:50.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
60352025-07-18T00:04:50.444ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
60362025-07-18T00:04:50.445ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
60372025-07-18T00:04:50.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
60382025-07-18T00:04:50.445ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
60392025-07-18T00:04:50.445ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
60402025-07-18T00:04:50.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
60412025-07-18T00:04:50.460ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60422025-07-18T00:04:50.460ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60432025-07-18T00:04:50.460ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 243.670071ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
60442025-07-18T00:04:50.498ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 zone_address = fd00:1122:3344:101::2
60452025-07-18T00:04:50.499ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60462025-07-18T00:04:50.500ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "898ca664-a16d-4d8f-8982-69627b71096b", "content-length": "26", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} })
60472025-07-18T00:04:50.500ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60482025-07-18T00:04:50.502ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
60492025-07-18T00:04:50.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60502025-07-18T00:04:50.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60512025-07-18T00:04:50.521ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
60522025-07-18T00:04:50.521ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
60532025-07-18T00:04:50.522ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e148539-95c5-4071-bc4a-53b07b673050", "content-length": "81", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} })
60542025-07-18T00:04:50.522ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60552025-07-18T00:04:50.526ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60562025-07-18T00:04:50.526ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60572025-07-18T00:04:50.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60582025-07-18T00:04:50.528ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
60592025-07-18T00:04:50.528ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
60602025-07-18T00:04:50.528ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60612025-07-18T00:04:50.528ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8b3aa4a-96d9-46f5-bac6-ce44b2ba9db9", "content-length": "81", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} })
60622025-07-18T00:04:50.529ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
60632025-07-18T00:04:50.529ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
60642025-07-18T00:04:50.529ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "f730835d-8862-4911-9ff4-e28a52c8c4f4", "content-length": "81", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} })
60652025-07-18T00:04:50.531ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 310.927717ms iteration = 27 status = {"errors":[],"sps":[]}
60662025-07-18T00:04:50.531ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60672025-07-18T00:04:50.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60682025-07-18T00:04:50.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60692025-07-18T00:04:50.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ce65a3e7-7738-442d-bd4d-5e19e4474806 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
60702025-07-18T00:04:50.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ce65a3e7-7738-442d-bd4d-5e19e4474806 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
60712025-07-18T00:04:50.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 6937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ce65a3e7-7738-442d-bd4d-5e19e4474806 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
60722025-07-18T00:04:50.556ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
60732025-07-18T00:04:50.556ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60742025-07-18T00:04:50.557ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2112b284-8973-4819-ae97-dbc2d930c349", "content-length": "26", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} })
60752025-07-18T00:04:50.557ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60762025-07-18T00:04:50.559ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60772025-07-18T00:04:50.566ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
60782025-07-18T00:04:50.566ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60792025-07-18T00:04:50.566ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "33e2e171-1cd7-4f18-9edf-ad75eb7e7744", "content-length": "372", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} })
60802025-07-18T00:04:50.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60812025-07-18T00:04:50.566ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
60822025-07-18T00:04:50.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60832025-07-18T00:04:50.577ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60842025-07-18T00:04:50.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60852025-07-18T00:04:50.579ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 370.963321ms iteration = 27 status = null
60862025-07-18T00:04:50.586ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
60872025-07-18T00:04:50.586ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
60882025-07-18T00:04:50.586ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8752cc0a-49c3-4c70-85a4-831426cad83a", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} })
60892025-07-18T00:04:50.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60902025-07-18T00:04:50.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60912025-07-18T00:04:50.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60922025-07-18T00:04:50.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60932025-07-18T00:04:50.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60942025-07-18T00:04:50.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60952025-07-18T00:04:50.595ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
60962025-07-18T00:04:50.598ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60972025-07-18T00:04:50.598ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60982025-07-18T00:04:50.598ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f9d4f32b-bf23-408c-b4d7-93b3c4f5764b", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} })
60992025-07-18T00:04:50.600ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 383.713858ms iteration = 28 status = {}
61002025-07-18T00:04:50.611ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
61012025-07-18T00:04:50.611ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 395.081602ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
61022025-07-18T00:04:50.746ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
61032025-07-18T00:04:50.746ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "907db6bf-75f4-417f-829b-fabffd7a487c", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61042025-07-18T00:04:50.746ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61052025-07-18T00:04:50.748ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "39c99b89-3856-442c-a3a6-dd8600390e94", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61062025-07-18T00:04:50.748ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61072025-07-18T00:04:50.750ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b167bb76-aa2a-4745-8687-9ab5e114ca63", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61082025-07-18T00:04:50.750ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61092025-07-18T00:04:50.753ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
61102025-07-18T00:04:50.753ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 544.290119ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
61112025-07-18T00:04:50.783ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 574.715948ms iteration = 27 status = {}
61122025-07-18T00:04:50.821ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
61132025-07-18T00:04:50.821ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "498b602e-3fb6-4a16-b34c-67fe23de31db", "content-length": "691", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} })
61142025-07-18T00:04:50.821ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
61152025-07-18T00:04:50.822ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
61162025-07-18T00:04:50.822ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
61172025-07-18T00:04:50.822ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
61182025-07-18T00:04:50.822ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "251360ee-1b05-4ed8-8290-cc3bd25a145e", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61192025-07-18T00:04:50.822ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61202025-07-18T00:04:50.823ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 607.048415ms iteration = 28 status = {}
61212025-07-18T00:04:50.824ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "12cb938e-a585-4e7c-bc64-5aa5c57ef422", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61222025-07-18T00:04:50.824ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61232025-07-18T00:04:50.827ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61242025-07-18T00:04:50.827ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 618.468291ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
61252025-07-18T00:04:50.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61262025-07-18T00:04:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61272025-07-18T00:04:50.885ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a2d734dc-e0c9-4fd6-b442-f2c4e63791e5, rack_id: e4e73d6b-d53c-414c-93a8-eff1ed3c4807, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(9d790dba-5335-4b4c-be2a-58416dc1e8f5) } rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
61282025-07-18T00:04:50.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61292025-07-18T00:04:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61302025-07-18T00:04:50.898ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
61312025-07-18T00:04:50.898ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 9d790dba-5335-4b4c-be2a-58416dc1e8f5
61322025-07-18T00:04:50.898ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
61332025-07-18T00:04:50.898ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61342025-07-18T00:04:50.898ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61352025-07-18T00:04:50.898ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61362025-07-18T00:04:50.898ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61372025-07-18T00:04:50.898ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61382025-07-18T00:04:50.899ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61392025-07-18T00:04:50.899ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61402025-07-18T00:04:50.899ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
61412025-07-18T00:04:50.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61422025-07-18T00:04:50.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61432025-07-18T00:04:50.902ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
61442025-07-18T00:04:50.902ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61452025-07-18T00:04:50.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 580 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 49f109a1-ce35-43c9-a09e-1aaed1fc518d response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
61462025-07-18T00:04:51.055ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8168c85f-5d73-4dfa-87b1-65c0782797c9", "date": "Fri, 18 Jul 2025 00:04:50 GMT"} })
61472025-07-18T00:04:51.055ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch = Switch0
61482025-07-18T00:04:51.055ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61492025-07-18T00:04:51.061ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e823a81-fc68-4488-8fcf-db623afa1b72", "content-length": "682", "date": "Fri, 18 Jul 2025 00:04:51 GMT"} })
61502025-07-18T00:04:51.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61512025-07-18T00:04:51.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61522025-07-18T00:04:51.065ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61532025-07-18T00:04:51.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61542025-07-18T00:04:51.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61552025-07-18T00:04:51.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61562025-07-18T00:04:51.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61572025-07-18T00:04:51.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61582025-07-18T00:04:51.077ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 861.073196ms iteration = 27 status = {}
61592025-07-18T00:04:51.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b028a4b9-e2fd-4acb-869c-1ce822620e2a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61602025-07-18T00:04:51.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b028a4b9-e2fd-4acb-869c-1ce822620e2a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61612025-07-18T00:04:51.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b028a4b9-e2fd-4acb-869c-1ce822620e2a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61622025-07-18T00:04:52.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e2e996a0-d728-421b-ad0b-08fd410e2678 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61632025-07-18T00:04:52.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e2e996a0-d728-421b-ad0b-08fd410e2678 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61642025-07-18T00:04:52.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e2e996a0-d728-421b-ad0b-08fd410e2678 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61652025-07-18T00:04:53.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 608f79cb-2f1e-460a-a286-2c489bcb2955 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61662025-07-18T00:04:53.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 608f79cb-2f1e-460a-a286-2c489bcb2955 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61672025-07-18T00:04:53.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 608f79cb-2f1e-460a-a286-2c489bcb2955 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61682025-07-18T00:04:54.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f833e50d-d870-4143-871c-852700fcc993 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61692025-07-18T00:04:54.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f833e50d-d870-4143-871c-852700fcc993 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61702025-07-18T00:04:54.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f833e50d-d870-4143-871c-852700fcc993 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61712025-07-18T00:04:55.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 158 reason = Timeout
61722025-07-18T00:04:55.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
61732025-07-18T00:04:55.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
61742025-07-18T00:04:55.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61752025-07-18T00:04:55.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
61762025-07-18T00:04:55.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
61772025-07-18T00:04:55.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
61782025-07-18T00:04:55.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
61792025-07-18T00:04:55.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.454714ms iteration = 158 status = {"chicken_switches_updated":false}
61802025-07-18T00:04:55.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0c5a38e7-5ec2-4983-a9df-69f31732cdd7 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61812025-07-18T00:04:55.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0c5a38e7-5ec2-4983-a9df-69f31732cdd7 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61822025-07-18T00:04:55.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0c5a38e7-5ec2-4983-a9df-69f31732cdd7 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61832025-07-18T00:04:56.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a71f6247-aacf-49f1-bb4a-c8325909906d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61842025-07-18T00:04:56.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a71f6247-aacf-49f1-bb4a-c8325909906d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61852025-07-18T00:04:56.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a71f6247-aacf-49f1-bb4a-c8325909906d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61862025-07-18T00:04:57.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4452f978-9df7-4d94-b672-67f5982b0dba roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61872025-07-18T00:04:57.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4452f978-9df7-4d94-b672-67f5982b0dba resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61882025-07-18T00:04:57.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4452f978-9df7-4d94-b672-67f5982b0dba response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61892025-07-18T00:04:58.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8e633109-35e2-4e04-8c32-f33c30188c78 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61902025-07-18T00:04:58.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8e633109-35e2-4e04-8c32-f33c30188c78 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61912025-07-18T00:04:58.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8e633109-35e2-4e04-8c32-f33c30188c78 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61922025-07-18T00:04:59.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f4e0a74b-b3e3-4f10-8051-92fb9ba7af94 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61932025-07-18T00:04:59.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f4e0a74b-b3e3-4f10-8051-92fb9ba7af94 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61942025-07-18T00:04:59.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f4e0a74b-b3e3-4f10-8051-92fb9ba7af94 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
61952025-07-18T00:05:00.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 159 reason = Timeout
61962025-07-18T00:05:00.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
61972025-07-18T00:05:00.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
61982025-07-18T00:05:00.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61992025-07-18T00:05:00.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
62002025-07-18T00:05:00.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
62012025-07-18T00:05:00.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
62022025-07-18T00:05:00.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
62032025-07-18T00:05:00.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
62042025-07-18T00:05:00.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62052025-07-18T00:05:00.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62062025-07-18T00:05:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62072025-07-18T00:05:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62082025-07-18T00:05:00.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
62092025-07-18T00:05:00.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.988598ms iteration = 159 status = {"chicken_switches_updated":false}
62102025-07-18T00:05:00.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62112025-07-18T00:05:00.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62122025-07-18T00:05:00.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62132025-07-18T00:05:00.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62142025-07-18T00:05:00.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62152025-07-18T00:05:00.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62162025-07-18T00:05:00.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62172025-07-18T00:05:00.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62182025-07-18T00:05:00.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62192025-07-18T00:05:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
62202025-07-18T00:05:00.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62212025-07-18T00:05:00.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62222025-07-18T00:05:00.244ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
62232025-07-18T00:05:00.244ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.447578ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
62242025-07-18T00:05:00.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.178044ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62252025-07-18T00:05:00.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e2a9a198-e91c-4608-a341-6cdc4cdea831 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62262025-07-18T00:05:00.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e2a9a198-e91c-4608-a341-6cdc4cdea831 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62272025-07-18T00:05:00.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e2a9a198-e91c-4608-a341-6cdc4cdea831 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62282025-07-18T00:05:00.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 654 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 3d4a6d4f-62c5-43aa-8220-cad172372520 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
62292025-07-18T00:05:01.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4efa3e7f-c592-42e5-ab36-d8bc683bc66c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62302025-07-18T00:05:01.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4efa3e7f-c592-42e5-ab36-d8bc683bc66c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62312025-07-18T00:05:01.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4efa3e7f-c592-42e5-ab36-d8bc683bc66c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62322025-07-18T00:05:02.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 059e7718-7074-4643-9ef3-ba6e6e236eca roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62332025-07-18T00:05:02.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 059e7718-7074-4643-9ef3-ba6e6e236eca resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62342025-07-18T00:05:02.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 059e7718-7074-4643-9ef3-ba6e6e236eca response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62352025-07-18T00:05:03.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9f8998e2-f329-4b3b-b6aa-fc2c904b30cb roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62362025-07-18T00:05:03.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9f8998e2-f329-4b3b-b6aa-fc2c904b30cb resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62372025-07-18T00:05:03.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9f8998e2-f329-4b3b-b6aa-fc2c904b30cb response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62382025-07-18T00:05:04.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 044ffea3-2256-4cdc-b1c0-4fc2bd39fe7f roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62392025-07-18T00:05:04.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 044ffea3-2256-4cdc-b1c0-4fc2bd39fe7f resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62402025-07-18T00:05:04.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 044ffea3-2256-4cdc-b1c0-4fc2bd39fe7f response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62412025-07-18T00:05:05.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 160 reason = Timeout
62422025-07-18T00:05:05.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
62432025-07-18T00:05:05.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
62442025-07-18T00:05:05.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62452025-07-18T00:05:05.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
62462025-07-18T00:05:05.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
62472025-07-18T00:05:05.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
62482025-07-18T00:05:05.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
62492025-07-18T00:05:05.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.156525ms iteration = 160 status = {"chicken_switches_updated":false}
62502025-07-18T00:05:05.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 04b4f7ad-6a2c-484d-b994-95b59f6f171a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62512025-07-18T00:05:05.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 04b4f7ad-6a2c-484d-b994-95b59f6f171a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62522025-07-18T00:05:05.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 04b4f7ad-6a2c-484d-b994-95b59f6f171a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62532025-07-18T00:05:06.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5e26960c-30a0-42bf-b6d6-da53b6a555ff roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62542025-07-18T00:05:06.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5e26960c-30a0-42bf-b6d6-da53b6a555ff resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62552025-07-18T00:05:06.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5e26960c-30a0-42bf-b6d6-da53b6a555ff response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62562025-07-18T00:05:07.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f7a78502-2bce-44e6-88b4-68b2efa9037a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62572025-07-18T00:05:07.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f7a78502-2bce-44e6-88b4-68b2efa9037a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62582025-07-18T00:05:07.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f7a78502-2bce-44e6-88b4-68b2efa9037a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62592025-07-18T00:05:08.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 704255e3-df33-41fe-8dd5-a7aa01f4fbe1 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62602025-07-18T00:05:08.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 704255e3-df33-41fe-8dd5-a7aa01f4fbe1 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62612025-07-18T00:05:08.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 704255e3-df33-41fe-8dd5-a7aa01f4fbe1 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62622025-07-18T00:05:09.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b9ad1491-0686-4bbd-9868-a0bd0fe76bad roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62632025-07-18T00:05:09.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b9ad1491-0686-4bbd-9868-a0bd0fe76bad resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62642025-07-18T00:05:09.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b9ad1491-0686-4bbd-9868-a0bd0fe76bad response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62652025-07-18T00:05:10.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 161 reason = Timeout
62662025-07-18T00:05:10.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
62672025-07-18T00:05:10.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
62682025-07-18T00:05:10.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62692025-07-18T00:05:10.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
62702025-07-18T00:05:10.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
62712025-07-18T00:05:10.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
62722025-07-18T00:05:10.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
62732025-07-18T00:05:10.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
62742025-07-18T00:05:10.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62752025-07-18T00:05:10.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62762025-07-18T00:05:10.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62772025-07-18T00:05:10.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62782025-07-18T00:05:10.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
62792025-07-18T00:05:10.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.48652ms iteration = 161 status = {"chicken_switches_updated":false}
62802025-07-18T00:05:10.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62812025-07-18T00:05:10.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62822025-07-18T00:05:10.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62832025-07-18T00:05:10.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62842025-07-18T00:05:10.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62852025-07-18T00:05:10.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62862025-07-18T00:05:10.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62872025-07-18T00:05:10.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
62882025-07-18T00:05:10.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62892025-07-18T00:05:10.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62902025-07-18T00:05:10.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
62912025-07-18T00:05:10.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.570646ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
62922025-07-18T00:05:10.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62932025-07-18T00:05:10.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62942025-07-18T00:05:10.251ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.813076ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62952025-07-18T00:05:10.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 401e05db-ae88-44c6-abe1-12501206af83 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62962025-07-18T00:05:10.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 401e05db-ae88-44c6-abe1-12501206af83 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62972025-07-18T00:05:10.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 401e05db-ae88-44c6-abe1-12501206af83 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
62982025-07-18T00:05:10.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 587 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 4687afff-8d36-4def-851e-1f40b1554df6 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
62992025-07-18T00:05:11.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8061a3e2-37c8-40a7-9ffa-77a3e3e5bf45 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63002025-07-18T00:05:11.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8061a3e2-37c8-40a7-9ffa-77a3e3e5bf45 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63012025-07-18T00:05:11.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8061a3e2-37c8-40a7-9ffa-77a3e3e5bf45 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63022025-07-18T00:05:12.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 75ccccb9-3319-41f7-bf22-d13ef13e862d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63032025-07-18T00:05:12.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 75ccccb9-3319-41f7-bf22-d13ef13e862d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63042025-07-18T00:05:12.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 75ccccb9-3319-41f7-bf22-d13ef13e862d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63052025-07-18T00:05:13.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1d5b5388-d656-4b26-b569-efeaf3bd4212 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63062025-07-18T00:05:13.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1d5b5388-d656-4b26-b569-efeaf3bd4212 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63072025-07-18T00:05:13.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1d5b5388-d656-4b26-b569-efeaf3bd4212 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63082025-07-18T00:05:14.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 272ba253-362b-41ff-ace7-a8d7ceca2a86 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63092025-07-18T00:05:14.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 272ba253-362b-41ff-ace7-a8d7ceca2a86 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63102025-07-18T00:05:14.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2738 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 272ba253-362b-41ff-ace7-a8d7ceca2a86 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63112025-07-18T00:05:15.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 162 reason = Timeout
63122025-07-18T00:05:15.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
63132025-07-18T00:05:15.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
63142025-07-18T00:05:15.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63152025-07-18T00:05:15.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
63162025-07-18T00:05:15.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
63172025-07-18T00:05:15.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
63182025-07-18T00:05:15.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
63192025-07-18T00:05:15.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.718909ms iteration = 162 status = {"chicken_switches_updated":false}
63202025-07-18T00:05:15.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = aaaaa443-2451-4d11-99fe-a41108a00833 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63212025-07-18T00:05:15.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = aaaaa443-2451-4d11-99fe-a41108a00833 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63222025-07-18T00:05:15.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = aaaaa443-2451-4d11-99fe-a41108a00833 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63232025-07-18T00:05:16.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4e90b78c-387b-4c09-b225-946d70756f9e roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63242025-07-18T00:05:16.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4e90b78c-387b-4c09-b225-946d70756f9e resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63252025-07-18T00:05:16.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4e90b78c-387b-4c09-b225-946d70756f9e response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63262025-07-18T00:05:17.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 401a472c-8d4a-4ee8-8b32-e6ca860fea34 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63272025-07-18T00:05:17.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 401a472c-8d4a-4ee8-8b32-e6ca860fea34 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63282025-07-18T00:05:17.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 401a472c-8d4a-4ee8-8b32-e6ca860fea34 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63292025-07-18T00:05:18.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 814b9962-ce02-4564-87de-1c5f3702ff7a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63302025-07-18T00:05:18.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 814b9962-ce02-4564-87de-1c5f3702ff7a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63312025-07-18T00:05:19.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 814b9962-ce02-4564-87de-1c5f3702ff7a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63322025-07-18T00:05:20.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = fa49e2d4-8a5f-4ea2-83e3-8be8be5abbcc roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63332025-07-18T00:05:20.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = fa49e2d4-8a5f-4ea2-83e3-8be8be5abbcc resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63342025-07-18T00:05:20.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = fa49e2d4-8a5f-4ea2-83e3-8be8be5abbcc response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
63352025-07-18T00:05:20.207ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
63362025-07-18T00:05:20.207ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
63372025-07-18T00:05:20.207ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
63382025-07-18T00:05:20.207ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
63392025-07-18T00:05:20.207ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63402025-07-18T00:05:20.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
63412025-07-18T00:05:20.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63422025-07-18T00:05:20.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 163 reason = Timeout
63432025-07-18T00:05:20.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
63442025-07-18T00:05:20.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
63452025-07-18T00:05:20.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1803, tv_nsec: 287948008 } })
63462025-07-18T00:05:20.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
63472025-07-18T00:05:20.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1803, tv_nsec: 288350754 } })
63482025-07-18T00:05:20.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
63492025-07-18T00:05:20.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63502025-07-18T00:05:20.211ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.995081ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
63512025-07-18T00:05:20.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
63522025-07-18T00:05:20.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
63532025-07-18T00:05:20.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
63542025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
63552025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
63562025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
63572025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63582025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63592025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
63602025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
63612025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63622025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63632025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
63642025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63652025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
63662025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
63672025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63682025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63692025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
63702025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63712025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
63722025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63732025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
63742025-07-18T00:05:20.216ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
63752025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63762025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
63772025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63782025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63792025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63802025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63812025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63822025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63832025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63842025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63852025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63862025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63872025-07-18T00:05:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63882025-07-18T00:05:20.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63892025-07-18T00:05:20.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
63902025-07-18T00:05:20.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.332469ms iteration = 163 status = {"chicken_switches_updated":false}
63912025-07-18T00:05:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
63922025-07-18T00:05:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
63932025-07-18T00:05:20.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
63942025-07-18T00:05:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
63952025-07-18T00:05:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63962025-07-18T00:05:20.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63972025-07-18T00:05:20.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
63982025-07-18T00:05:20.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63992025-07-18T00:05:20.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64002025-07-18T00:05:20.219ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 28 reason = Timeout
64012025-07-18T00:05:20.219ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
64022025-07-18T00:05:20.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
64032025-07-18T00:05:20.220ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
64042025-07-18T00:05:20.220ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
64052025-07-18T00:05:20.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
64062025-07-18T00:05:20.220ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 28 reason = Timeout
64072025-07-18T00:05:20.220ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1803, tv_nsec: 298203676 } })
64082025-07-18T00:05:20.220ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64092025-07-18T00:05:20.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64102025-07-18T00:05:20.223ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64112025-07-18T00:05:20.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64122025-07-18T00:05:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64132025-07-18T00:05:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
64142025-07-18T00:05:20.224ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
64152025-07-18T00:05:20.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
64162025-07-18T00:05:20.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64172025-07-18T00:05:20.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64182025-07-18T00:05:20.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64192025-07-18T00:05:20.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64202025-07-18T00:05:20.226ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64212025-07-18T00:05:20.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64222025-07-18T00:05:20.227ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64232025-07-18T00:05:20.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64242025-07-18T00:05:20.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64252025-07-18T00:05:20.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64262025-07-18T00:05:20.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64272025-07-18T00:05:20.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64282025-07-18T00:05:20.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64292025-07-18T00:05:20.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64302025-07-18T00:05:20.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.709945ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
64312025-07-18T00:05:20.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.897809ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64322025-07-18T00:05:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
64332025-07-18T00:05:20.231ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64342025-07-18T00:05:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64352025-07-18T00:05:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
64362025-07-18T00:05:20.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64372025-07-18T00:05:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64382025-07-18T00:05:20.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64392025-07-18T00:05:20.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64402025-07-18T00:05:20.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64412025-07-18T00:05:20.233ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 14.356861ms iteration = 28 status = {"errors":[],"requests_created_ok":[]}
64422025-07-18T00:05:20.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64432025-07-18T00:05:20.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64442025-07-18T00:05:20.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64452025-07-18T00:05:20.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64462025-07-18T00:05:20.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64472025-07-18T00:05:20.236ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64482025-07-18T00:05:20.237ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1803, tv_nsec: 314685269 } })
64492025-07-18T00:05:20.237ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
64502025-07-18T00:05:20.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64512025-07-18T00:05:20.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64522025-07-18T00:05:20.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64532025-07-18T00:05:20.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64542025-07-18T00:05:20.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64552025-07-18T00:05:20.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64562025-07-18T00:05:20.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
64572025-07-18T00:05:20.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64582025-07-18T00:05:20.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64592025-07-18T00:05:20.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64602025-07-18T00:05:20.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64612025-07-18T00:05:20.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
64622025-07-18T00:05:20.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.43887ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
64632025-07-18T00:05:20.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64642025-07-18T00:05:20.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64652025-07-18T00:05:20.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64662025-07-18T00:05:20.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64672025-07-18T00:05:20.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64682025-07-18T00:05:20.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64692025-07-18T00:05:20.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64702025-07-18T00:05:20.277ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64712025-07-18T00:05:20.277ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64722025-07-18T00:05:20.277ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.246712ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
64732025-07-18T00:05:20.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64742025-07-18T00:05:20.279ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64752025-07-18T00:05:20.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64762025-07-18T00:05:20.281ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64772025-07-18T00:05:20.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64782025-07-18T00:05:20.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 66.619585ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
64792025-07-18T00:05:20.287ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64802025-07-18T00:05:20.289ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64812025-07-18T00:05:20.289ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
64822025-07-18T00:05:20.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64832025-07-18T00:05:20.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64842025-07-18T00:05:20.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
64852025-07-18T00:05:20.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64862025-07-18T00:05:20.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64872025-07-18T00:05:20.291ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64882025-07-18T00:05:20.291ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
64892025-07-18T00:05:20.291ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64902025-07-18T00:05:20.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64912025-07-18T00:05:20.294ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.387887ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64922025-07-18T00:05:20.298ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
64932025-07-18T00:05:20.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
64942025-07-18T00:05:20.299ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64952025-07-18T00:05:20.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64962025-07-18T00:05:20.300ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64972025-07-18T00:05:20.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64982025-07-18T00:05:20.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64992025-07-18T00:05:20.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65002025-07-18T00:05:20.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
65012025-07-18T00:05:20.304ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65022025-07-18T00:05:20.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65032025-07-18T00:05:20.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65042025-07-18T00:05:20.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65052025-07-18T00:05:20.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, lookup_type: ById(4a597d98-bd6a-42be-a09e-71b1fbba6de5) } result = Ok(())
65062025-07-18T00:05:20.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65072025-07-18T00:05:20.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65082025-07-18T00:05:20.310ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 94.797899ms iteration = 28 status = 0
65092025-07-18T00:05:20.314ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 98.625398ms iteration = 31 status = {"physical_disks_added":0}
65102025-07-18T00:05:20.344ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65112025-07-18T00:05:20.344ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
65122025-07-18T00:05:20.344ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.925625ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
65132025-07-18T00:05:20.350ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65142025-07-18T00:05:20.350ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 134.003903ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65152025-07-18T00:05:20.358ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 140.027816ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
65162025-07-18T00:05:20.359ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:389
65172025-07-18T00:05:20.359ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 143.154635ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
65182025-07-18T00:05:20.379ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
65192025-07-18T00:05:20.380ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb8ae39c-06d2-437e-933a-864af73761e8", "content-length": "78", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
65202025-07-18T00:05:20.380ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
65212025-07-18T00:05:20.380ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
65222025-07-18T00:05:20.380ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
65232025-07-18T00:05:20.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
65242025-07-18T00:05:20.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
65252025-07-18T00:05:20.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
65262025-07-18T00:05:20.382ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
65272025-07-18T00:05:20.382ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
65282025-07-18T00:05:20.384ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
65292025-07-18T00:05:20.384ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
65302025-07-18T00:05:20.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
65312025-07-18T00:05:20.385ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
65322025-07-18T00:05:20.385ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
65332025-07-18T00:05:20.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
65342025-07-18T00:05:20.429ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
65352025-07-18T00:05:20.429ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
65362025-07-18T00:05:20.430ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "abca2d8e-c9eb-4175-985b-02aa0bc671c6", "content-length": "81", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
65372025-07-18T00:05:20.435ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
65382025-07-18T00:05:20.439ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
65392025-07-18T00:05:20.439ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
65402025-07-18T00:05:20.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
65412025-07-18T00:05:20.441ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
65422025-07-18T00:05:20.441ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
65432025-07-18T00:05:20.444ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9016e0b-1567-4308-bc03-0067c76c5ac5", "content-length": "81", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
65442025-07-18T00:05:20.450ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
65452025-07-18T00:05:20.450ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
65462025-07-18T00:05:20.450ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7e22a4b-bf4a-4b14-a0a5-87a72eb68875", "content-length": "81", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
65472025-07-18T00:05:20.452ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 232.292596ms iteration = 28 status = {"errors":[],"sps":[]}
65482025-07-18T00:05:20.515ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 zone_address = fd00:1122:3344:101::2
65492025-07-18T00:05:20.515ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65502025-07-18T00:05:20.515ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee16dbb3-4992-424e-8a71-732db242c188", "content-length": "26", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
65512025-07-18T00:05:20.515ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65522025-07-18T00:05:20.518ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
65532025-07-18T00:05:20.523ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
65542025-07-18T00:05:20.523ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65552025-07-18T00:05:20.524ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6965c714-9c37-46f4-9b4f-da952362d575", "content-length": "26", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
65562025-07-18T00:05:20.524ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65572025-07-18T00:05:20.526ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65582025-07-18T00:05:20.540ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
65592025-07-18T00:05:20.540ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65602025-07-18T00:05:20.541ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7088b14d-f5be-4f46-8e41-822ec37f87a3", "content-length": "372", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
65612025-07-18T00:05:20.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65622025-07-18T00:05:20.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65632025-07-18T00:05:20.559ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
65642025-07-18T00:05:20.559ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65652025-07-18T00:05:20.559ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ea91073-7c42-4fe7-9710-e9af7a97bbae", "content-length": "26", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
65662025-07-18T00:05:20.559ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65672025-07-18T00:05:20.561ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
65682025-07-18T00:05:20.561ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
65692025-07-18T00:05:20.561ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a82d165c-d62a-4e88-9822-5c32a9ff5755", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
65702025-07-18T00:05:20.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65712025-07-18T00:05:20.561ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65722025-07-18T00:05:20.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65732025-07-18T00:05:20.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65742025-07-18T00:05:20.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65752025-07-18T00:05:20.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65762025-07-18T00:05:20.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65772025-07-18T00:05:20.574ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
65782025-07-18T00:05:20.574ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65792025-07-18T00:05:20.574ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0d4fbff6-3b77-4826-8ac1-478d5334779e", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
65802025-07-18T00:05:20.576ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 360.688412ms iteration = 29 status = {}
65812025-07-18T00:05:20.665ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65822025-07-18T00:05:20.666ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c28eda75-90d1-4c10-9424-44cf24842e61", "content-length": "691", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
65832025-07-18T00:05:20.666ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
65842025-07-18T00:05:20.666ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
65852025-07-18T00:05:20.666ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
65862025-07-18T00:05:20.668ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 452.146151ms iteration = 29 status = {}
65872025-07-18T00:05:20.675ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65882025-07-18T00:05:20.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65892025-07-18T00:05:20.677ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 469.871684ms iteration = 28 status = null
65902025-07-18T00:05:20.689ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 482.160333ms iteration = 28 status = {}
65912025-07-18T00:05:20.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65922025-07-18T00:05:20.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65932025-07-18T00:05:20.735ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a2d734dc-e0c9-4fd6-b442-f2c4e63791e5, rack_id: e4e73d6b-d53c-414c-93a8-eff1ed3c4807, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(9d790dba-5335-4b4c-be2a-58416dc1e8f5) } rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
65942025-07-18T00:05:20.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65952025-07-18T00:05:20.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65962025-07-18T00:05:20.748ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
65972025-07-18T00:05:20.748ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 9d790dba-5335-4b4c-be2a-58416dc1e8f5
65982025-07-18T00:05:20.748ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
65992025-07-18T00:05:20.748ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66002025-07-18T00:05:20.748ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66012025-07-18T00:05:20.749ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66022025-07-18T00:05:20.749ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66032025-07-18T00:05:20.749ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66042025-07-18T00:05:20.749ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66052025-07-18T00:05:20.749ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66062025-07-18T00:05:20.749ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
66072025-07-18T00:05:20.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66082025-07-18T00:05:20.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66092025-07-18T00:05:20.751ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
66102025-07-18T00:05:20.751ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
66112025-07-18T00:05:20.859ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3c235a2c-212a-4ce4-8504-04a225766370", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
66122025-07-18T00:05:20.859ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch = Switch0
66132025-07-18T00:05:20.859ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
66142025-07-18T00:05:20.864ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e40d1a64-716f-45b9-b3f3-797212deed0f", "content-length": "682", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
66152025-07-18T00:05:20.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66162025-07-18T00:05:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66172025-07-18T00:05:20.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66182025-07-18T00:05:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66192025-07-18T00:05:20.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66202025-07-18T00:05:20.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66212025-07-18T00:05:20.874ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66222025-07-18T00:05:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66232025-07-18T00:05:20.881ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 666.026594ms iteration = 28 status = {}
66242025-07-18T00:05:20.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 665 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 4b8daac6-d095-469d-9788-ed1f4ece34e6 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
66252025-07-18T00:05:21.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7e8a24bf-43bd-437d-9bcf-c71284e2139d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66262025-07-18T00:05:21.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7e8a24bf-43bd-437d-9bcf-c71284e2139d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66272025-07-18T00:05:21.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7e8a24bf-43bd-437d-9bcf-c71284e2139d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66282025-07-18T00:05:21.297ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 5
66292025-07-18T00:05:21.297ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221
66302025-07-18T00:05:21.328ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
66312025-07-18T00:05:21.328ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:63277
66322025-07-18T00:05:21.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:63277 req_id = 927e28be-fae2-4fb1-b071-0367a2e675d8 roles = RoleSet { roles: {} } uri = /metrics/producers
66332025-07-18T00:05:21.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:63277 req_id = 927e28be-fae2-4fb1-b071-0367a2e675d8 resource = Database result = Ok(()) uri = /metrics/producers
66342025-07-18T00:05:21.366ZINFOnexus: assigned collector to new producer collector_id = 13431648-c0eb-4fbe-bcca-ada1fdea1060 file = nexus/src/app/oximeter.rs:76 producer_id = 79e7c92c-8e83-4180-bbfe-92325edee698
66352025-07-18T00:05:21.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 37819 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:63277 req_id = 927e28be-fae2-4fb1-b071-0367a2e675d8 response_code = 201 uri = /metrics/producers
66362025-07-18T00:05:21.366ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "927e28be-fae2-4fb1-b071-0367a2e675d8", "content-length": "41", "date": "Fri, 18 Jul 2025 00:05:20 GMT"} })
66372025-07-18T00:05:21.369ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
66382025-07-18T00:05:22.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7ec457ef-d4ad-4683-8f81-63f8d072bcc1 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66392025-07-18T00:05:22.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7ec457ef-d4ad-4683-8f81-63f8d072bcc1 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66402025-07-18T00:05:22.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7ec457ef-d4ad-4683-8f81-63f8d072bcc1 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66412025-07-18T00:05:23.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 577e8fad-a328-4caa-aab7-4e042fddfedd roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66422025-07-18T00:05:23.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 577e8fad-a328-4caa-aab7-4e042fddfedd resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66432025-07-18T00:05:23.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 577e8fad-a328-4caa-aab7-4e042fddfedd response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66442025-07-18T00:05:24.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9db24981-82ee-4d57-bd3d-6c7ee5c27a3d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66452025-07-18T00:05:24.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9db24981-82ee-4d57-bd3d-6c7ee5c27a3d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66462025-07-18T00:05:24.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9db24981-82ee-4d57-bd3d-6c7ee5c27a3d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66472025-07-18T00:05:25.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a2f68483-f8c4-4b7f-b241-c2687956352a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66482025-07-18T00:05:25.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a2f68483-f8c4-4b7f-b241-c2687956352a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66492025-07-18T00:05:25.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a2f68483-f8c4-4b7f-b241-c2687956352a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66502025-07-18T00:05:25.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 164 reason = Timeout
66512025-07-18T00:05:25.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
66522025-07-18T00:05:25.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
66532025-07-18T00:05:25.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66542025-07-18T00:05:25.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
66552025-07-18T00:05:25.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
66562025-07-18T00:05:25.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
66572025-07-18T00:05:25.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
66582025-07-18T00:05:25.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.526031ms iteration = 164 status = {"chicken_switches_updated":false}
66592025-07-18T00:05:26.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 20bb9aad-6bad-43e7-848a-f44aba0820d2 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66602025-07-18T00:05:26.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 20bb9aad-6bad-43e7-848a-f44aba0820d2 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66612025-07-18T00:05:26.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 20bb9aad-6bad-43e7-848a-f44aba0820d2 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66622025-07-18T00:05:27.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4077915d-72c0-454b-87a3-0c76fe25eeae roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66632025-07-18T00:05:27.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4077915d-72c0-454b-87a3-0c76fe25eeae resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66642025-07-18T00:05:27.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 4077915d-72c0-454b-87a3-0c76fe25eeae response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66652025-07-18T00:05:28.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bce8ac63-1099-4b59-af4e-fcd41cb5aea8 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66662025-07-18T00:05:28.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bce8ac63-1099-4b59-af4e-fcd41cb5aea8 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66672025-07-18T00:05:28.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = bce8ac63-1099-4b59-af4e-fcd41cb5aea8 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66682025-07-18T00:05:29.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1930d8e7-eae5-4f8d-ae9a-ea40ff93e7bf roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66692025-07-18T00:05:29.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1930d8e7-eae5-4f8d-ae9a-ea40ff93e7bf resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66702025-07-18T00:05:29.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1930d8e7-eae5-4f8d-ae9a-ea40ff93e7bf response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66712025-07-18T00:05:30.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 798c47a3-c0cf-4db2-8566-fd44114deb87 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66722025-07-18T00:05:30.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 798c47a3-c0cf-4db2-8566-fd44114deb87 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66732025-07-18T00:05:30.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 798c47a3-c0cf-4db2-8566-fd44114deb87 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
66742025-07-18T00:05:30.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 165 reason = Timeout
66752025-07-18T00:05:30.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
66762025-07-18T00:05:30.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
66772025-07-18T00:05:30.213ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66782025-07-18T00:05:30.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
66792025-07-18T00:05:30.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
66802025-07-18T00:05:30.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66812025-07-18T00:05:30.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66822025-07-18T00:05:30.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66832025-07-18T00:05:30.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66842025-07-18T00:05:30.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
66852025-07-18T00:05:30.217ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
66862025-07-18T00:05:30.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
66872025-07-18T00:05:30.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66882025-07-18T00:05:30.219ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
66892025-07-18T00:05:30.219ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 9.7649ms iteration = 165 status = {"chicken_switches_updated":false}
66902025-07-18T00:05:30.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66912025-07-18T00:05:30.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66922025-07-18T00:05:30.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66932025-07-18T00:05:30.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66942025-07-18T00:05:30.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66952025-07-18T00:05:30.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66962025-07-18T00:05:30.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
66972025-07-18T00:05:30.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66982025-07-18T00:05:30.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66992025-07-18T00:05:30.239ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
67002025-07-18T00:05:30.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.979293ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
67012025-07-18T00:05:30.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67022025-07-18T00:05:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67032025-07-18T00:05:30.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.51473ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67042025-07-18T00:05:30.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 635 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 53210318-4211-446d-ae3e-09404f4a4db4 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
67052025-07-18T00:05:31.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 24711b38-8f86-40c9-9c2c-d88be918fb06 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67062025-07-18T00:05:31.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 24711b38-8f86-40c9-9c2c-d88be918fb06 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67072025-07-18T00:05:31.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 24711b38-8f86-40c9-9c2c-d88be918fb06 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67082025-07-18T00:05:32.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 009c14cb-7d24-4eea-87e5-9cfeb07ed3ef roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67092025-07-18T00:05:32.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 009c14cb-7d24-4eea-87e5-9cfeb07ed3ef resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67102025-07-18T00:05:32.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 009c14cb-7d24-4eea-87e5-9cfeb07ed3ef response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67112025-07-18T00:05:33.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 77357d71-8e0a-4efd-a241-449a4be282fc roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67122025-07-18T00:05:33.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 77357d71-8e0a-4efd-a241-449a4be282fc resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67132025-07-18T00:05:33.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 77357d71-8e0a-4efd-a241-449a4be282fc response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67142025-07-18T00:05:34.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1d6577df-a61b-421a-ab93-a53296dfe9c7 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67152025-07-18T00:05:34.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1d6577df-a61b-421a-ab93-a53296dfe9c7 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67162025-07-18T00:05:34.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1d6577df-a61b-421a-ab93-a53296dfe9c7 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67172025-07-18T00:05:35.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 166 reason = Timeout
67182025-07-18T00:05:35.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
67192025-07-18T00:05:35.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
67202025-07-18T00:05:35.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67212025-07-18T00:05:35.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
67222025-07-18T00:05:35.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
67232025-07-18T00:05:35.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
67242025-07-18T00:05:35.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
67252025-07-18T00:05:35.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.745979ms iteration = 166 status = {"chicken_switches_updated":false}
67262025-07-18T00:05:35.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e806e081-0d86-4ff6-9e5e-32a020c07536 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67272025-07-18T00:05:35.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e806e081-0d86-4ff6-9e5e-32a020c07536 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67282025-07-18T00:05:35.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e806e081-0d86-4ff6-9e5e-32a020c07536 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67292025-07-18T00:05:36.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 908318c5-3cd9-4b51-a127-1ca5c80bd719 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67302025-07-18T00:05:36.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 908318c5-3cd9-4b51-a127-1ca5c80bd719 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67312025-07-18T00:05:36.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 908318c5-3cd9-4b51-a127-1ca5c80bd719 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67322025-07-18T00:05:37.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3609919b-eb6d-4122-8cc6-fd9f8c922338 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67332025-07-18T00:05:37.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3609919b-eb6d-4122-8cc6-fd9f8c922338 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67342025-07-18T00:05:37.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3609919b-eb6d-4122-8cc6-fd9f8c922338 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67352025-07-18T00:05:38.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f54bb272-e260-4bb2-a7ff-4acbdfca842d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67362025-07-18T00:05:38.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f54bb272-e260-4bb2-a7ff-4acbdfca842d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67372025-07-18T00:05:38.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f54bb272-e260-4bb2-a7ff-4acbdfca842d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67382025-07-18T00:05:39.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0c39453c-a3c9-4498-a4bb-68b36716b86d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67392025-07-18T00:05:39.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0c39453c-a3c9-4498-a4bb-68b36716b86d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67402025-07-18T00:05:39.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0c39453c-a3c9-4498-a4bb-68b36716b86d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67412025-07-18T00:05:40.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 167 reason = Timeout
67422025-07-18T00:05:40.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
67432025-07-18T00:05:40.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
67442025-07-18T00:05:40.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67452025-07-18T00:05:40.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
67462025-07-18T00:05:40.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
67472025-07-18T00:05:40.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
67482025-07-18T00:05:40.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
67492025-07-18T00:05:40.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
67502025-07-18T00:05:40.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67512025-07-18T00:05:40.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67522025-07-18T00:05:40.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67532025-07-18T00:05:40.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67542025-07-18T00:05:40.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
67552025-07-18T00:05:40.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.904197ms iteration = 167 status = {"chicken_switches_updated":false}
67562025-07-18T00:05:40.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67572025-07-18T00:05:40.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67582025-07-18T00:05:40.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67592025-07-18T00:05:40.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.308451ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67602025-07-18T00:05:40.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67612025-07-18T00:05:40.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67622025-07-18T00:05:40.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67632025-07-18T00:05:40.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67642025-07-18T00:05:40.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67652025-07-18T00:05:40.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67662025-07-18T00:05:40.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
67672025-07-18T00:05:40.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67682025-07-18T00:05:40.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67692025-07-18T00:05:40.238ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
67702025-07-18T00:05:40.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.301509ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
67712025-07-18T00:05:40.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1417dc9f-fbd5-4e70-be68-e3a0e13251d1 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67722025-07-18T00:05:40.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1417dc9f-fbd5-4e70-be68-e3a0e13251d1 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67732025-07-18T00:05:40.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1855 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1417dc9f-fbd5-4e70-be68-e3a0e13251d1 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67742025-07-18T00:05:40.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 647 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = d97b5d95-6d21-4a07-b7d0-4af13997e80c response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
67752025-07-18T00:05:41.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 27e8d9ea-c2b8-4182-b8ed-ac1871dfd053 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67762025-07-18T00:05:41.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 27e8d9ea-c2b8-4182-b8ed-ac1871dfd053 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67772025-07-18T00:05:41.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 27e8d9ea-c2b8-4182-b8ed-ac1871dfd053 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67782025-07-18T00:05:42.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 05e7101a-9119-4b0e-b6dd-8ac9ebaf624d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67792025-07-18T00:05:42.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 05e7101a-9119-4b0e-b6dd-8ac9ebaf624d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67802025-07-18T00:05:42.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 05e7101a-9119-4b0e-b6dd-8ac9ebaf624d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67812025-07-18T00:05:43.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e782877a-850b-4103-b49f-3105bd9be40a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67822025-07-18T00:05:43.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e782877a-850b-4103-b49f-3105bd9be40a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67832025-07-18T00:05:43.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = e782877a-850b-4103-b49f-3105bd9be40a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67842025-07-18T00:05:44.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f1dd48ad-4dc1-475d-ae11-6ec50032a08c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67852025-07-18T00:05:44.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f1dd48ad-4dc1-475d-ae11-6ec50032a08c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67862025-07-18T00:05:44.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f1dd48ad-4dc1-475d-ae11-6ec50032a08c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67872025-07-18T00:05:45.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 168 reason = Timeout
67882025-07-18T00:05:45.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
67892025-07-18T00:05:45.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
67902025-07-18T00:05:45.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67912025-07-18T00:05:45.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
67922025-07-18T00:05:45.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
67932025-07-18T00:05:45.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
67942025-07-18T00:05:45.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
67952025-07-18T00:05:45.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.19417ms iteration = 168 status = {"chicken_switches_updated":false}
67962025-07-18T00:05:45.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 933a49b0-c312-48e8-887d-12707a6a2ffb roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67972025-07-18T00:05:45.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 933a49b0-c312-48e8-887d-12707a6a2ffb resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67982025-07-18T00:05:45.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 933a49b0-c312-48e8-887d-12707a6a2ffb response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
67992025-07-18T00:05:46.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7970365c-0927-4d9e-9f1c-978f838156e0 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
68002025-07-18T00:05:46.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7970365c-0927-4d9e-9f1c-978f838156e0 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
68012025-07-18T00:05:46.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 7970365c-0927-4d9e-9f1c-978f838156e0 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
68022025-07-18T00:05:47.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f16d903a-0aad-4909-bc51-8ec0ba3b792c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
68032025-07-18T00:05:47.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f16d903a-0aad-4909-bc51-8ec0ba3b792c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
68042025-07-18T00:05:47.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f16d903a-0aad-4909-bc51-8ec0ba3b792c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
68052025-07-18T00:05:48.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2ce6e6de-a87e-478c-89aa-f9b439bae387 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
68062025-07-18T00:05:48.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2ce6e6de-a87e-478c-89aa-f9b439bae387 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
68072025-07-18T00:05:48.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 2ce6e6de-a87e-478c-89aa-f9b439bae387 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
68082025-07-18T00:05:49.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d5445a3e-f4fa-4edc-a72f-1ec4bb43a77c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
68092025-07-18T00:05:49.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d5445a3e-f4fa-4edc-a72f-1ec4bb43a77c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
68102025-07-18T00:05:49.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = d5445a3e-f4fa-4edc-a72f-1ec4bb43a77c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
68112025-07-18T00:05:50.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
68122025-07-18T00:05:50.205ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
68132025-07-18T00:05:50.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68142025-07-18T00:05:50.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68152025-07-18T00:05:50.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68162025-07-18T00:05:50.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68172025-07-18T00:05:50.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68182025-07-18T00:05:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
68192025-07-18T00:05:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
68202025-07-18T00:05:50.207ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
68212025-07-18T00:05:50.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
68222025-07-18T00:05:50.207ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
68232025-07-18T00:05:50.207ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
68242025-07-18T00:05:50.207ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68252025-07-18T00:05:50.207ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
68262025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
68272025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
68282025-07-18T00:05:50.208ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-17 23:55:50.208010286 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
68292025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
68302025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
68312025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
68322025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
68332025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68342025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68352025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68362025-07-18T00:05:50.208ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("56b8d8b3-74d8-49ff-9bba-ff575bfeff38.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b6789fb-7f6d-466d-9e8d-08234eb15cb4.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eee78e3b-9d92-4bbf-a496-9511487338e5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("eee78e3b-9d92-4bbf-a496-9511487338e5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:3::1)) }], valid_until: Instant { tv_sec: 1833, tv_nsec: 285784605 } })
68372025-07-18T00:05:50.208ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("464a3447-fe1f-417e-b585-925f5fb5bfdc.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da3261f0-45ba-4fbf-b6bb-a5a70850db80.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("da3261f0-45ba-4fbf-b6bb-a5a70850db80.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1833, tv_nsec: 285795235 } })
68382025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68392025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68402025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
68412025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
68422025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
68432025-07-18T00:05:50.208ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 9092da00-a622-42cf-99af-453ea64d4a35
68442025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.67\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"9092da00-a622-42cf-99af-453ea64d4a35"}
68452025-07-18T00:05:50.208ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
68462025-07-18T00:05:50.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.142528ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
68472025-07-18T00:05:50.209ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
68482025-07-18T00:05:50.209ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 994.265\u{b5}s iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
68492025-07-18T00:05:50.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68502025-07-18T00:05:50.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68512025-07-18T00:05:50.209ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 19 reason = Timeout
68522025-07-18T00:05:50.209ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
68532025-07-18T00:05:50.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 169 reason = Timeout
68542025-07-18T00:05:50.209ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 13.46\u{b5}s iteration = 19 status = "Disabled"
68552025-07-18T00:05:50.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
68562025-07-18T00:05:50.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1833, tv_nsec: 287406559 } })
68572025-07-18T00:05:50.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
68582025-07-18T00:05:50.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
68592025-07-18T00:05:50.210ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.60322ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
68602025-07-18T00:05:50.210ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68612025-07-18T00:05:50.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68622025-07-18T00:05:50.212ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68632025-07-18T00:05:50.212ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-17 23:55:50.208010286 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
68642025-07-18T00:05:50.212ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.035542ms iteration = 15 status = {"expiration":"2025-07-17T23:55:50.208010286Z","pruned":[]}
68652025-07-18T00:05:50.212ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1833, tv_nsec: 289607293 } })
68662025-07-18T00:05:50.212ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
68672025-07-18T00:05:50.213ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68682025-07-18T00:05:50.213ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68692025-07-18T00:05:50.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68702025-07-18T00:05:50.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68712025-07-18T00:05:50.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68722025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
68732025-07-18T00:05:50.216ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
68742025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
68752025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68762025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68772025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
68782025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68792025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
68802025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
68812025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
68822025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68832025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
68842025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68852025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
68862025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
68872025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68882025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
68892025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68902025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
68912025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68922025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 29 reason = Timeout
68932025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68942025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
68952025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68962025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
68972025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
68982025-07-18T00:05:50.216ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
68992025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69002025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69012025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
69022025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69032025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69042025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69052025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69062025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69072025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
69082025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69092025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69102025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69112025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69122025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69132025-07-18T00:05:50.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69142025-07-18T00:05:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69152025-07-18T00:05:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69162025-07-18T00:05:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69172025-07-18T00:05:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69182025-07-18T00:05:50.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69192025-07-18T00:05:50.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69202025-07-18T00:05:50.218ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
69212025-07-18T00:05:50.218ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
69222025-07-18T00:05:50.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
69232025-07-18T00:05:50.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69242025-07-18T00:05:50.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
69252025-07-18T00:05:50.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69262025-07-18T00:05:50.218ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
69272025-07-18T00:05:50.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69282025-07-18T00:05:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69292025-07-18T00:05:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69302025-07-18T00:05:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69312025-07-18T00:05:50.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
69322025-07-18T00:05:50.219ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 15 reason = Timeout
69332025-07-18T00:05:50.219ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
69342025-07-18T00:05:50.219ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
69352025-07-18T00:05:50.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69362025-07-18T00:05:50.219ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 15 reason = Timeout
69372025-07-18T00:05:50.219ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
69382025-07-18T00:05:50.219ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69392025-07-18T00:05:50.219ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 29 reason = Timeout
69402025-07-18T00:05:50.220ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
69412025-07-18T00:05:50.220ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 29 reason = Timeout
69422025-07-18T00:05:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69432025-07-18T00:05:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
69442025-07-18T00:05:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
69452025-07-18T00:05:50.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
69462025-07-18T00:05:50.220ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1833, tv_nsec: 297787059 } })
69472025-07-18T00:05:50.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
69482025-07-18T00:05:50.221ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69492025-07-18T00:05:50.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69502025-07-18T00:05:50.222ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69512025-07-18T00:05:50.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69522025-07-18T00:05:50.222ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69532025-07-18T00:05:50.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69542025-07-18T00:05:50.223ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69552025-07-18T00:05:50.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
69562025-07-18T00:05:50.224ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69572025-07-18T00:05:50.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69582025-07-18T00:05:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
69592025-07-18T00:05:50.226ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69602025-07-18T00:05:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69612025-07-18T00:05:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69622025-07-18T00:05:50.228ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69632025-07-18T00:05:50.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69642025-07-18T00:05:50.229ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.762536ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
69652025-07-18T00:05:50.233ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
69662025-07-18T00:05:50.233ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 13.117122ms iteration = 15 status = {"by_rx":{},"error":null}
69672025-07-18T00:05:50.284ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
69682025-07-18T00:05:50.284ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
69692025-07-18T00:05:50.284ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
69702025-07-18T00:05:50.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69712025-07-18T00:05:50.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69722025-07-18T00:05:50.288ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69732025-07-18T00:05:50.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
69742025-07-18T00:05:50.293ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
69752025-07-18T00:05:50.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
69762025-07-18T00:05:50.296ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
69772025-07-18T00:05:50.296ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
69782025-07-18T00:05:50.296ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
69792025-07-18T00:05:50.296ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69802025-07-18T00:05:50.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69812025-07-18T00:05:50.299ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69822025-07-18T00:05:50.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69832025-07-18T00:05:50.302ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69842025-07-18T00:05:50.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69852025-07-18T00:05:50.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69862025-07-18T00:05:50.302ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69872025-07-18T00:05:50.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69882025-07-18T00:05:50.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69892025-07-18T00:05:50.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69902025-07-18T00:05:50.303ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69912025-07-18T00:05:50.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69922025-07-18T00:05:50.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69932025-07-18T00:05:50.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69942025-07-18T00:05:50.305ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
69952025-07-18T00:05:50.305ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.59938ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
69962025-07-18T00:05:50.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69972025-07-18T00:05:50.306ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69982025-07-18T00:05:50.306ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69992025-07-18T00:05:50.306ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70002025-07-18T00:05:50.306ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70012025-07-18T00:05:50.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70022025-07-18T00:05:50.306ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
70032025-07-18T00:05:50.306ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 96.845431ms iteration = 169 status = {"chicken_switches_updated":false}
70042025-07-18T00:05:50.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 86.733445ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
70052025-07-18T00:05:50.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70062025-07-18T00:05:50.306ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
70072025-07-18T00:05:50.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
70082025-07-18T00:05:50.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 91.244595ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70092025-07-18T00:05:50.308ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-4a597d98-bd6a-42be-a09e-71b1fbba6de5.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1833, tv_nsec: 385643802 } })
70102025-07-18T00:05:50.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70112025-07-18T00:05:50.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70122025-07-18T00:05:50.308ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
70132025-07-18T00:05:50.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70142025-07-18T00:05:50.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70152025-07-18T00:05:50.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70162025-07-18T00:05:50.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70172025-07-18T00:05:50.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70182025-07-18T00:05:50.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70192025-07-18T00:05:50.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70202025-07-18T00:05:50.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70212025-07-18T00:05:50.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70222025-07-18T00:05:50.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70232025-07-18T00:05:50.312ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 92.714757ms iteration = 15 status = {"dispatched":[],"errors":[],"glob_version":"165.0.0","globs_reprocessed":{},"no_receivers":[]}
70242025-07-18T00:05:50.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70252025-07-18T00:05:50.315ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70262025-07-18T00:05:50.317ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70272025-07-18T00:05:50.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
70282025-07-18T00:05:50.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70292025-07-18T00:05:50.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70302025-07-18T00:05:50.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70312025-07-18T00:05:50.318ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70322025-07-18T00:05:50.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70332025-07-18T00:05:50.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70342025-07-18T00:05:50.322ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 103.701567ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
70352025-07-18T00:05:50.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70362025-07-18T00:05:50.326ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
70372025-07-18T00:05:50.326ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
70382025-07-18T00:05:50.326ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 110.381349ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
70392025-07-18T00:05:50.328ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70402025-07-18T00:05:50.328ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70412025-07-18T00:05:50.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70422025-07-18T00:05:50.335ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70432025-07-18T00:05:50.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70442025-07-18T00:05:50.336ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 116.522363ms iteration = 29 status = {"errors":[],"requests_created_ok":[]}
70452025-07-18T00:05:50.345ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
70462025-07-18T00:05:50.345ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 129.487563ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
70472025-07-18T00:05:50.359ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
70482025-07-18T00:05:50.359ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
70492025-07-18T00:05:50.359ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 143.499279ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
70502025-07-18T00:05:50.370ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70512025-07-18T00:05:50.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70522025-07-18T00:05:50.371ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70532025-07-18T00:05:50.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70542025-07-18T00:05:50.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70552025-07-18T00:05:50.373ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70562025-07-18T00:05:50.373ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70572025-07-18T00:05:50.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70582025-07-18T00:05:50.374ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
70592025-07-18T00:05:50.374ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2be4d985-6e68-40d2-a5d1-ba1e291e5f99 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
70602025-07-18T00:05:50.374ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70612025-07-18T00:05:50.375ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70622025-07-18T00:05:50.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70632025-07-18T00:05:50.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
70642025-07-18T00:05:50.375ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70652025-07-18T00:05:50.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70662025-07-18T00:05:50.376ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70672025-07-18T00:05:50.377ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:389
70682025-07-18T00:05:50.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 161.300864ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70692025-07-18T00:05:50.377ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 161.198862ms iteration = 29 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
70702025-07-18T00:05:50.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70712025-07-18T00:05:50.378ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70722025-07-18T00:05:50.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70732025-07-18T00:05:50.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a597d98-bd6a-42be-a09e-71b1fbba6de5, lookup_type: ById(4a597d98-bd6a-42be-a09e-71b1fbba6de5) } result = Ok(())
70742025-07-18T00:05:50.379ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70752025-07-18T00:05:50.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70762025-07-18T00:05:50.381ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70772025-07-18T00:05:50.381ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70782025-07-18T00:05:50.381ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70792025-07-18T00:05:50.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70802025-07-18T00:05:50.381ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 165.186113ms iteration = 29 status = 0
70812025-07-18T00:05:50.381ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 162.874407ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70822025-07-18T00:05:50.381ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
70832025-07-18T00:05:50.381ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a5c2ae61-5a10-495b-8726-f2f7ed24b4a0 dns_zone_name = oxide.test found_so_far = 0 version = 2
70842025-07-18T00:05:50.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70852025-07-18T00:05:50.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70862025-07-18T00:05:50.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70872025-07-18T00:05:50.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70882025-07-18T00:05:50.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70892025-07-18T00:05:50.383ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70902025-07-18T00:05:50.384ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70912025-07-18T00:05:50.384ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70922025-07-18T00:05:50.384ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
70932025-07-18T00:05:50.384ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 167.797654ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
70942025-07-18T00:05:50.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70952025-07-18T00:05:50.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70962025-07-18T00:05:50.385ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2be4d985-6e68-40d2-a5d1-ba1e291e5f99 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
70972025-07-18T00:05:50.385ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
70982025-07-18T00:05:50.385ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-17 23:52:10.609253 UTC dns_group = internal generation = 1
70992025-07-18T00:05:50.385ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 180.222035ms iteration = 15 status = {"generation":1}
71002025-07-18T00:05:50.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71012025-07-18T00:05:50.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71022025-07-18T00:05:50.387ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71032025-07-18T00:05:50.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71042025-07-18T00:05:50.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71052025-07-18T00:05:50.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71062025-07-18T00:05:50.389ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a5c2ae61-5a10-495b-8726-f2f7ed24b4a0 dns_zone_name = oxide.test found_so_far = 4 version = 2
71072025-07-18T00:05:50.389ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
71082025-07-18T00:05:50.389ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-17 23:52:11.153706 UTC dns_group = external generation = 2
71092025-07-18T00:05:50.389ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 181.385103ms iteration = 15 status = {"generation":2}
71102025-07-18T00:05:50.390ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
71112025-07-18T00:05:50.391ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
71122025-07-18T00:05:50.409ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71132025-07-18T00:05:50.412ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71142025-07-18T00:05:50.412ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71152025-07-18T00:05:50.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71162025-07-18T00:05:50.432ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71172025-07-18T00:05:50.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71182025-07-18T00:05:50.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 224.153591ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71192025-07-18T00:05:50.462ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
71202025-07-18T00:05:50.462ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71212025-07-18T00:05:50.462ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71222025-07-18T00:05:50.462ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbca00f2-4fdf-452f-bad0-96d5ed6dbe35", "content-length": "26", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} })
71232025-07-18T00:05:50.462ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71242025-07-18T00:05:50.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71252025-07-18T00:05:50.466ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71262025-07-18T00:05:50.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 42ba15e4-2d81-4c4a-a32d-239a8f7f3442 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
71272025-07-18T00:05:50.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 42ba15e4-2d81-4c4a-a32d-239a8f7f3442 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
71282025-07-18T00:05:50.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 42ba15e4-2d81-4c4a-a32d-239a8f7f3442 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
71292025-07-18T00:05:50.502ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-17T23:51:46.880014Z, time_modified: 2025-07-17T23:51:46.880014Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f37123ec-61ff-4793-867b-6920b7f6246a, db_silo: Silo { identity: SiloIdentity { id: f37123ec-61ff-4793-867b-6920b7f6246a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-17T23:52:11.102986Z, time_modified: 2025-07-17T23:52:11.102986Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f37123ec-61ff-4793-867b-6920b7f6246a, db_silo: Silo { identity: SiloIdentity { id: f37123ec-61ff-4793-867b-6920b7f6246a, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-17T23:52:11.102986Z, time_modified: 2025-07-17T23:52:11.102986Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3" }] }) }
71302025-07-18T00:05:50.502ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 294.298551ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f37123ec-61ff-4793-867b-6920b7f6246a","tls_certs":["6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3"]}},"default_endpoint":{"silo_id":"f37123ec-61ff-4793-867b-6920b7f6246a","tls_certs":["6ac1888e0cf45a886210e3a84885b8f62f4da0799cf72b429266be20fe5c75d3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
71312025-07-18T00:05:50.520ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 zone_address = fd00:1122:3344:101::2
71322025-07-18T00:05:50.520ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71332025-07-18T00:05:50.520ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e841fb74-171d-49e8-b8a6-238237df44de", "content-length": "26", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} })
71342025-07-18T00:05:50.520ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71352025-07-18T00:05:50.522ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
71362025-07-18T00:05:50.522ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71372025-07-18T00:05:50.522ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
71382025-07-18T00:05:50.523ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66c9331e-be00-4bb4-9e88-a15869111359", "content-length": "26", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} })
71392025-07-18T00:05:50.523ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71402025-07-18T00:05:50.524ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71412025-07-18T00:05:50.536ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 319.730423ms iteration = 32 status = {"physical_disks_added":0}
71422025-07-18T00:05:50.538ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids
71432025-07-18T00:05:50.538ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/all-sp-ids", status: 200, headers: {"content-type": "application/json", "x-request-id": "66f17726-16b8-4a05-8250-bb50f32f339c", "content-length": "78", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} })
71442025-07-18T00:05:50.539ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
71452025-07-18T00:05:50.539ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
71462025-07-18T00:05:50.539ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
71472025-07-18T00:05:50.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
71482025-07-18T00:05:50.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
71492025-07-18T00:05:50.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
71502025-07-18T00:05:50.541ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = switch
71512025-07-18T00:05:50.542ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 0 sp_type = sled
71522025-07-18T00:05:50.542ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } slot = 1 sp_type = sled
71532025-07-18T00:05:50.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = switch
71542025-07-18T00:05:50.545ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = switch
71552025-07-18T00:05:50.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = switch
71562025-07-18T00:05:50.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 1 sp_type = sled
71572025-07-18T00:05:50.546ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 1 sp_type = sled
71582025-07-18T00:05:50.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 1 sp_type = sled
71592025-07-18T00:05:50.550ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 1 sp_type = sled start_ena = None
71602025-07-18T00:05:50.550ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
71612025-07-18T00:05:50.551ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/1/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a2bd5dc-82e1-4f43-b65d-35338a3afca0", "content-length": "81", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} })
71622025-07-18T00:05:50.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Fleet result = Ok(()) slot = 0 sp_type = sled
71632025-07-18T00:05:50.551ZDEBGnexus (BackgroundTasks): roles background_task = sp_ereport_ingester roles = RoleSet { roles: {} } slot = 0 sp_type = sled
71642025-07-18T00:05:50.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = sp_ereport_ingester resource = Database result = Ok(()) slot = 0 sp_type = sled
71652025-07-18T00:05:50.553ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = sled start_ena = None
71662025-07-18T00:05:50.553ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
71672025-07-18T00:05:50.554ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "cac519fd-8f86-4405-9919-85bcb1a44e87", "content-length": "81", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} })
71682025-07-18T00:05:50.578ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
71692025-07-18T00:05:50.578ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a86bb36f-bf06-4852-aac2-9dbcfd913adf", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71702025-07-18T00:05:50.578ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71712025-07-18T00:05:50.580ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "dda7c85a-a299-4b7d-b1e2-834b8dc13d75", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71722025-07-18T00:05:50.580ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71732025-07-18T00:05:50.583ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71742025-07-18T00:05:50.583ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 375.136415ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
71752025-07-18T00:05:50.600ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
71762025-07-18T00:05:50.606ZDEBGnexus (BackgroundTasks): attempting ereport collection from MGS background_task = sp_ereport_ingester committed_ena = None gateway_addr = [fd00:1122:3344:101::2]:12225 restart_id = 00000000-0000-0000-0000-000000000000 (ereporter_restart) slot = 0 sp_type = switch start_ena = None
71772025-07-18T00:05:50.606ZDEBGnexus (BackgroundTasks): client request background_task = sp_ereport_ingester body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = POST uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000
71782025-07-18T00:05:50.607ZDEBGnexus (BackgroundTasks): client response background_task = sp_ereport_ingester gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/ereports?limit=255&restart_id=00000000-0000-0000-0000-000000000000", status: 200, headers: {"content-type": "application/json", "x-request-id": "9edaa86a-40cb-4fe3-aa2a-ef62519ef0a2", "content-length": "81", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} })
71792025-07-18T00:05:50.609ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 389.0963ms iteration = 29 status = {"errors":[],"sps":[]}
71802025-07-18T00:05:50.631ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
71812025-07-18T00:05:50.631ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 414.929318ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
71822025-07-18T00:05:50.640ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71832025-07-18T00:05:50.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71842025-07-18T00:05:50.642ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 435.010757ms iteration = 29 status = null
71852025-07-18T00:05:50.652ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71862025-07-18T00:05:50.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71872025-07-18T00:05:50.654ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71882025-07-18T00:05:50.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71892025-07-18T00:05:50.657ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71902025-07-18T00:05:50.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71912025-07-18T00:05:50.658ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71922025-07-18T00:05:50.661ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71932025-07-18T00:05:50.661ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71942025-07-18T00:05:50.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71952025-07-18T00:05:50.684ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71962025-07-18T00:05:50.684ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71972025-07-18T00:05:50.685ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb9dad3b-0e73-4e9b-86fc-f6bbb5dcd319", "content-length": "372", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} })
71982025-07-18T00:05:50.685ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71992025-07-18T00:05:50.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72002025-07-18T00:05:50.698ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 490.628473ms iteration = 29 status = {}
72012025-07-18T00:05:50.747ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
72022025-07-18T00:05:50.748ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72032025-07-18T00:05:50.748ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b22120a8-a585-49b1-9ae5-1a8846c73003", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} })
72042025-07-18T00:05:50.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72052025-07-18T00:05:50.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72062025-07-18T00:05:50.750ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72072025-07-18T00:05:50.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72082025-07-18T00:05:50.754ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72092025-07-18T00:05:50.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72102025-07-18T00:05:50.758ZINFOnexus (BackgroundTasks): VPC route manager sled 4a597d98-bd6a-42be-a09e-71b1fbba6de5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72112025-07-18T00:05:50.758ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72122025-07-18T00:05:50.758ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9abf9878-4887-456d-8080-590c800386b8", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} })
72132025-07-18T00:05:50.760ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 543.502557ms iteration = 30 status = {}
72142025-07-18T00:05:50.822ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
72152025-07-18T00:05:50.823ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "fb8e88cf-bfb9-4d6d-9ba0-3e94ff09f60b", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
72162025-07-18T00:05:50.823ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
72172025-07-18T00:05:50.825ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c1ff4bac-e7ec-4560-9495-cb3f8f9b020f", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
72182025-07-18T00:05:50.825ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
72192025-07-18T00:05:50.827ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7b4f6662-360b-45b6-8273-fb2245d9cb27", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
72202025-07-18T00:05:50.827ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
72212025-07-18T00:05:50.829ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
72222025-07-18T00:05:50.829ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 621.199394ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
72232025-07-18T00:05:50.909ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72242025-07-18T00:05:50.909ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a597d98-bd6a-42be-a09e-71b1fbba6de5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ee081e8-cf56-4f34-aa8c-7aba50fe73a1", "content-length": "691", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} })
72252025-07-18T00:05:50.909ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
72262025-07-18T00:05:50.909ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
72272025-07-18T00:05:50.909ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
72282025-07-18T00:05:50.911ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 695.01853ms iteration = 30 status = {}
72292025-07-18T00:05:50.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72302025-07-18T00:05:50.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72312025-07-18T00:05:50.946ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: a2d734dc-e0c9-4fd6-b442-f2c4e63791e5, rack_id: e4e73d6b-d53c-414c-93a8-eff1ed3c4807, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(9d790dba-5335-4b4c-be2a-58416dc1e8f5) } rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
72322025-07-18T00:05:50.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72332025-07-18T00:05:50.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72342025-07-18T00:05:50.959ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
72352025-07-18T00:05:50.959ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 9d790dba-5335-4b4c-be2a-58416dc1e8f5
72362025-07-18T00:05:50.959ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72372025-07-18T00:05:50.959ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72382025-07-18T00:05:50.959ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72392025-07-18T00:05:50.959ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72402025-07-18T00:05:50.959ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72412025-07-18T00:05:50.959ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72422025-07-18T00:05:50.959ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72432025-07-18T00:05:50.959ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72442025-07-18T00:05:50.960ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807
72452025-07-18T00:05:50.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72462025-07-18T00:05:50.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72472025-07-18T00:05:50.962ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch_location = Switch0
72482025-07-18T00:05:50.962ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72492025-07-18T00:05:50.964ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:50475
72502025-07-18T00:05:50.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50475 req_id = 148609f0-65f7-4db6-88bc-64f14f7b2ff7 roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
72512025-07-18T00:05:50.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50475 req_id = 148609f0-65f7-4db6-88bc-64f14f7b2ff7 resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
72522025-07-18T00:05:50.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50475 req_id = 148609f0-65f7-4db6-88bc-64f14f7b2ff7 response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
72532025-07-18T00:05:50.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50475 req_id = d473ccc4-77be-431d-b20d-9a3255e04324 roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
72542025-07-18T00:05:50.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50475 req_id = d473ccc4-77be-431d-b20d-9a3255e04324 resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
72552025-07-18T00:05:50.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50475 req_id = d473ccc4-77be-431d-b20d-9a3255e04324 response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
72562025-07-18T00:05:50.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 580 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 3285422a-e4a2-4aa7-a7be-720fb5768d3a response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
72572025-07-18T00:05:51.078ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b346fd0b-0f4e-46bb-bdad-6178fc6e724c", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} })
72582025-07-18T00:05:51.078ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 switch = Switch0
72592025-07-18T00:05:51.078ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72602025-07-18T00:05:51.083ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e4e73d6b-d53c-414c-93a8-eff1ed3c4807 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ad29098-5500-4257-add6-f32b1b1be09a", "content-length": "682", "date": "Fri, 18 Jul 2025 00:05:50 GMT"} })
72612025-07-18T00:05:51.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72622025-07-18T00:05:51.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72632025-07-18T00:05:51.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72642025-07-18T00:05:51.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72652025-07-18T00:05:51.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72662025-07-18T00:05:51.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72672025-07-18T00:05:51.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72682025-07-18T00:05:51.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72692025-07-18T00:05:51.100ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 883.870038ms iteration = 29 status = {}
72702025-07-18T00:05:51.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = eb85afc2-6e40-4e4d-8348-ba7813c83c39 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72712025-07-18T00:05:51.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = eb85afc2-6e40-4e4d-8348-ba7813c83c39 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72722025-07-18T00:05:51.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = eb85afc2-6e40-4e4d-8348-ba7813c83c39 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72732025-07-18T00:05:52.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 82bc477b-c366-4b26-a77d-f6fdde3ddef4 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72742025-07-18T00:05:52.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 82bc477b-c366-4b26-a77d-f6fdde3ddef4 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72752025-07-18T00:05:52.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 82bc477b-c366-4b26-a77d-f6fdde3ddef4 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72762025-07-18T00:05:53.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 20748acb-4cd8-488c-8e64-d83b4e287436 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72772025-07-18T00:05:53.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 20748acb-4cd8-488c-8e64-d83b4e287436 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72782025-07-18T00:05:53.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 20748acb-4cd8-488c-8e64-d83b4e287436 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72792025-07-18T00:05:54.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f9348d4a-4dec-4bc3-a232-ef33863ef943 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72802025-07-18T00:05:54.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f9348d4a-4dec-4bc3-a232-ef33863ef943 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72812025-07-18T00:05:54.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f9348d4a-4dec-4bc3-a232-ef33863ef943 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72822025-07-18T00:05:55.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 170 reason = Timeout
72832025-07-18T00:05:55.209ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
72842025-07-18T00:05:55.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
72852025-07-18T00:05:55.211ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72862025-07-18T00:05:55.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
72872025-07-18T00:05:55.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
72882025-07-18T00:05:55.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
72892025-07-18T00:05:55.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
72902025-07-18T00:05:55.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.905026ms iteration = 170 status = {"chicken_switches_updated":false}
72912025-07-18T00:05:55.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3a04c151-794f-41ac-a017-95e49c88201d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72922025-07-18T00:05:55.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3a04c151-794f-41ac-a017-95e49c88201d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72932025-07-18T00:05:55.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3a04c151-794f-41ac-a017-95e49c88201d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72942025-07-18T00:05:56.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ab5eb4db-efac-48b4-a8ec-ace22d2d0fd8 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72952025-07-18T00:05:56.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ab5eb4db-efac-48b4-a8ec-ace22d2d0fd8 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72962025-07-18T00:05:56.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ab5eb4db-efac-48b4-a8ec-ace22d2d0fd8 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72972025-07-18T00:05:57.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0d507835-6129-4ec8-82b1-51904ce9a70a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72982025-07-18T00:05:57.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0d507835-6129-4ec8-82b1-51904ce9a70a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
72992025-07-18T00:05:57.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0d507835-6129-4ec8-82b1-51904ce9a70a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73002025-07-18T00:05:58.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1fbb3707-4681-425b-a985-3805a3ba5d47 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73012025-07-18T00:05:58.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1fbb3707-4681-425b-a985-3805a3ba5d47 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73022025-07-18T00:05:58.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1fbb3707-4681-425b-a985-3805a3ba5d47 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73032025-07-18T00:05:59.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0737cb4e-aee6-4921-a581-f0115ae1fe93 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73042025-07-18T00:05:59.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0737cb4e-aee6-4921-a581-f0115ae1fe93 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73052025-07-18T00:05:59.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0737cb4e-aee6-4921-a581-f0115ae1fe93 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73062025-07-18T00:06:00.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 171 reason = Timeout
73072025-07-18T00:06:00.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
73082025-07-18T00:06:00.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
73092025-07-18T00:06:00.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73102025-07-18T00:06:00.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
73112025-07-18T00:06:00.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
73122025-07-18T00:06:00.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
73132025-07-18T00:06:00.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
73142025-07-18T00:06:00.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
73152025-07-18T00:06:00.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73162025-07-18T00:06:00.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73172025-07-18T00:06:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73182025-07-18T00:06:00.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73192025-07-18T00:06:00.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73202025-07-18T00:06:00.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
73212025-07-18T00:06:00.218ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.649217ms iteration = 171 status = {"chicken_switches_updated":false}
73222025-07-18T00:06:00.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73232025-07-18T00:06:00.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73242025-07-18T00:06:00.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73252025-07-18T00:06:00.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73262025-07-18T00:06:00.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73272025-07-18T00:06:00.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73282025-07-18T00:06:00.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
73292025-07-18T00:06:00.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73302025-07-18T00:06:00.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73312025-07-18T00:06:00.241ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
73322025-07-18T00:06:00.241ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.287679ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
73332025-07-18T00:06:00.254ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73342025-07-18T00:06:00.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73352025-07-18T00:06:00.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.644083ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73362025-07-18T00:06:00.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9a4129b8-8856-4c8d-b7cc-790666b85092 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73372025-07-18T00:06:00.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9a4129b8-8856-4c8d-b7cc-790666b85092 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73382025-07-18T00:06:00.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 9a4129b8-8856-4c8d-b7cc-790666b85092 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73392025-07-18T00:06:00.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 668 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = 2afdf0f3-b913-423a-85ab-7243f36bb5c2 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
73402025-07-18T00:06:01.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0de0c97d-1596-47c7-9e7e-d6d6f78a1191 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73412025-07-18T00:06:01.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0de0c97d-1596-47c7-9e7e-d6d6f78a1191 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73422025-07-18T00:06:01.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 0de0c97d-1596-47c7-9e7e-d6d6f78a1191 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73432025-07-18T00:06:02.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 538e8f80-9de8-41cb-a44d-6d6f01e537c3 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73442025-07-18T00:06:02.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 538e8f80-9de8-41cb-a44d-6d6f01e537c3 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73452025-07-18T00:06:02.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 538e8f80-9de8-41cb-a44d-6d6f01e537c3 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73462025-07-18T00:06:03.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b68cd13c-36f0-4f69-8198-f466338d37e3 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73472025-07-18T00:06:03.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b68cd13c-36f0-4f69-8198-f466338d37e3 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73482025-07-18T00:06:03.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b68cd13c-36f0-4f69-8198-f466338d37e3 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73492025-07-18T00:06:04.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3b5f8b10-6f35-4c09-82b0-a7122824c3c3 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73502025-07-18T00:06:04.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3b5f8b10-6f35-4c09-82b0-a7122824c3c3 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73512025-07-18T00:06:04.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 3b5f8b10-6f35-4c09-82b0-a7122824c3c3 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73522025-07-18T00:06:05.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 172 reason = Timeout
73532025-07-18T00:06:05.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
73542025-07-18T00:06:05.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
73552025-07-18T00:06:05.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73562025-07-18T00:06:05.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
73572025-07-18T00:06:05.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
73582025-07-18T00:06:05.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
73592025-07-18T00:06:05.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
73602025-07-18T00:06:05.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.093259ms iteration = 172 status = {"chicken_switches_updated":false}
73612025-07-18T00:06:05.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8360c20f-1f84-41d3-8d7d-e0608db2c304 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73622025-07-18T00:06:05.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8360c20f-1f84-41d3-8d7d-e0608db2c304 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73632025-07-18T00:06:05.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 8360c20f-1f84-41d3-8d7d-e0608db2c304 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73642025-07-18T00:06:05.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50475 req_id = 23c67e61-5c3c-4c07-9445-dca2a5e11934 roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
73652025-07-18T00:06:05.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50475 req_id = 23c67e61-5c3c-4c07-9445-dca2a5e11934 resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
73662025-07-18T00:06:05.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50475 req_id = 23c67e61-5c3c-4c07-9445-dca2a5e11934 response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?sort_by=id_ascending
73672025-07-18T00:06:05.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50475 req_id = ef109e3c-1f6b-4a28-923c-cb3b557afc03 roles = RoleSet { roles: {} } uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
73682025-07-18T00:06:05.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50475 req_id = ef109e3c-1f6b-4a28-923c-cb3b557afc03 resource = Database result = Ok(()) uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
73692025-07-18T00:06:05.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50475 req_id = ef109e3c-1f6b-4a28-923c-cb3b557afc03 response_code = 200 uri = /metrics/collectors/13431648-c0eb-4fbe-bcca-ada1fdea1060/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjNjMxNWE3My1hY2YzLTQxMjYtOThkMC1jMWIzMGYxYWUxMTYifX0%3D
73702025-07-18T00:06:06.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 531a004b-8547-4e14-a1dd-550748b3e07d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73712025-07-18T00:06:06.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 531a004b-8547-4e14-a1dd-550748b3e07d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73722025-07-18T00:06:06.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 531a004b-8547-4e14-a1dd-550748b3e07d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73732025-07-18T00:06:07.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a7991afc-9973-43cd-aa35-8bf563991638 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73742025-07-18T00:06:07.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a7991afc-9973-43cd-aa35-8bf563991638 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73752025-07-18T00:06:07.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a7991afc-9973-43cd-aa35-8bf563991638 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73762025-07-18T00:06:08.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ddbc5af3-281b-431c-a4b8-ae0d06092548 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73772025-07-18T00:06:08.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ddbc5af3-281b-431c-a4b8-ae0d06092548 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73782025-07-18T00:06:08.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = ddbc5af3-281b-431c-a4b8-ae0d06092548 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73792025-07-18T00:06:09.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f5a9fde6-8806-4201-a862-3ddbabb8794a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73802025-07-18T00:06:09.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f5a9fde6-8806-4201-a862-3ddbabb8794a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73812025-07-18T00:06:09.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = f5a9fde6-8806-4201-a862-3ddbabb8794a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
73822025-07-18T00:06:10.210ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 173 reason = Timeout
73832025-07-18T00:06:10.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
73842025-07-18T00:06:10.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
73852025-07-18T00:06:10.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73862025-07-18T00:06:10.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
73872025-07-18T00:06:10.214ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
73882025-07-18T00:06:10.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
73892025-07-18T00:06:10.216ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
73902025-07-18T00:06:10.216ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 5.978172ms iteration = 173 status = {"chicken_switches_updated":false}
73912025-07-18T00:06:10.216ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
73922025-07-18T00:06:10.216ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
73932025-07-18T00:06:10.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73942025-07-18T00:06:10.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73952025-07-18T00:06:10.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73962025-07-18T00:06:10.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73972025-07-18T00:06:10.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73982025-07-18T00:06:10.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73992025-07-18T00:06:10.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74002025-07-18T00:06:10.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.522629ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74012025-07-18T00:06:10.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74022025-07-18T00:06:10.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74032025-07-18T00:06:10.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74042025-07-18T00:06:10.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74052025-07-18T00:06:10.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74062025-07-18T00:06:10.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74072025-07-18T00:06:10.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9092da00-a622-42cf-99af-453ea64d4a35, lookup_type: ById(9092da00-a622-42cf-99af-453ea64d4a35) } result = Ok(())
74082025-07-18T00:06:10.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74092025-07-18T00:06:10.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74102025-07-18T00:06:10.239ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9092da00-a622-42cf-99af-453ea64d4a35 original_time_created = 2025-07-17 23:51:43.799561 UTC target_id = 9092da00-a622-42cf-99af-453ea64d4a35 time_created = 2025-07-17 23:51:43.799561 UTC
74112025-07-18T00:06:10.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.032254ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9092da00-a622-42cf-99af-453ea64d4a35","time_created":"2025-07-17T23:51:43.799561Z"}
74122025-07-18T00:06:10.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1074b0b3-8d30-4bb9-86e3-965c16e7e50a roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74132025-07-18T00:06:10.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1074b0b3-8d30-4bb9-86e3-965c16e7e50a resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74142025-07-18T00:06:10.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 1074b0b3-8d30-4bb9-86e3-965c16e7e50a response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74152025-07-18T00:06:10.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 676 local_addr = [fd00:1122:3344:101::b]:65426 method = GET remote_addr = [fd00:1122:3344:101::d]:60344 req_id = c470124b-5c3c-4b27-ad99-366d811396f0 response_code = 200 uri = /79e7c92c-8e83-4180-bbfe-92325edee698
74162025-07-18T00:06:11.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = cb090e30-db76-483e-9a1a-8562a862d769 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74172025-07-18T00:06:11.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = cb090e30-db76-483e-9a1a-8562a862d769 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74182025-07-18T00:06:11.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = cb090e30-db76-483e-9a1a-8562a862d769 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74192025-07-18T00:06:12.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a032b976-4b54-4d04-adb2-e62ff18e2515 roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74202025-07-18T00:06:12.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a032b976-4b54-4d04-adb2-e62ff18e2515 resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74212025-07-18T00:06:12.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = a032b976-4b54-4d04-adb2-e62ff18e2515 response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74222025-07-18T00:06:13.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = acc2d7dc-09b1-4d3b-b0f4-9bf0ebf67e7f roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74232025-07-18T00:06:13.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = acc2d7dc-09b1-4d3b-b0f4-9bf0ebf67e7f resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74242025-07-18T00:06:13.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = acc2d7dc-09b1-4d3b-b0f4-9bf0ebf67e7f response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74252025-07-18T00:06:14.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5517d3cc-8a66-4e83-8ede-f6dd829fd64d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74262025-07-18T00:06:14.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5517d3cc-8a66-4e83-8ede-f6dd829fd64d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74272025-07-18T00:06:14.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 5517d3cc-8a66-4e83-8ede-f6dd829fd64d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74282025-07-18T00:06:15.209ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 174 reason = Timeout
74292025-07-18T00:06:15.210ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
74302025-07-18T00:06:15.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
74312025-07-18T00:06:15.212ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74322025-07-18T00:06:15.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
74332025-07-18T00:06:15.215ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
74342025-07-18T00:06:15.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
74352025-07-18T00:06:15.217ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
74362025-07-18T00:06:15.217ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.564886ms iteration = 174 status = {"chicken_switches_updated":false}
74372025-07-18T00:06:15.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b69b95a7-b6b0-4c18-9934-e63a789db94c roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74382025-07-18T00:06:15.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b69b95a7-b6b0-4c18-9934-e63a789db94c resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74392025-07-18T00:06:15.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = b69b95a7-b6b0-4c18-9934-e63a789db94c response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74402025-07-18T00:06:16.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 191991ca-fed0-4037-9b57-b65401fe9f9d roles = RoleSet { roles: {} } uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74412025-07-18T00:06:16.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 191991ca-fed0-4037-9b57-b65401fe9f9d resource = Database result = Ok(()) uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5
74422025-07-18T00:06:16.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33033 req_id = 191991ca-fed0-4037-9b57-b65401fe9f9d response_code = 200 uri = /probes/4a597d98-bd6a-42be-a09e-71b1fbba6de5