Max level shown:
12025-08-12T22:45:02.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d3e4ae30-b3c4-494c-b154-bcf1f44c618e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22025-08-12T22:45:02.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d3e4ae30-b3c4-494c-b154-bcf1f44c618e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32025-08-12T22:45:02.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d3e4ae30-b3c4-494c-b154-bcf1f44c618e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
42025-08-12T22:45:03.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7134006f-bfd9-4fa1-b7d0-5f1fc053c318 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
52025-08-12T22:45:03.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7134006f-bfd9-4fa1-b7d0-5f1fc053c318 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
62025-08-12T22:45:03.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7134006f-bfd9-4fa1-b7d0-5f1fc053c318 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
72025-08-12T22:45:04.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 14876910-bb55-46de-af52-4c740108bd84 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82025-08-12T22:45:04.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 14876910-bb55-46de-af52-4c740108bd84 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
92025-08-12T22:45:04.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 14876910-bb55-46de-af52-4c740108bd84 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
102025-08-12T22:45:05.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8b091b19-3ecb-4b58-b82a-cc85f972cf4f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
112025-08-12T22:45:05.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8b091b19-3ecb-4b58-b82a-cc85f972cf4f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
122025-08-12T22:45:05.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8b091b19-3ecb-4b58-b82a-cc85f972cf4f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
132025-08-12T22:45:06.040ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 22 reason = Timeout
142025-08-12T22:45:06.040ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
152025-08-12T22:45:06.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
162025-08-12T22:45:06.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
172025-08-12T22:45:06.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
182025-08-12T22:45:06.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
192025-08-12T22:45:06.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
202025-08-12T22:45:06.048ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
212025-08-12T22:45:06.048ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.917708ms iteration = 22 status = {"chicken_switches_updated":false}
222025-08-12T22:45:06.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f394cb35-beda-435d-9a47-241057fe6bfe roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
232025-08-12T22:45:06.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f394cb35-beda-435d-9a47-241057fe6bfe resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
242025-08-12T22:45:06.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f394cb35-beda-435d-9a47-241057fe6bfe response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
252025-08-12T22:45:07.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = beed2768-7ab1-453e-a6f9-7af33b4fc8ff roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
262025-08-12T22:45:07.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = beed2768-7ab1-453e-a6f9-7af33b4fc8ff resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
272025-08-12T22:45:07.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = beed2768-7ab1-453e-a6f9-7af33b4fc8ff response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
282025-08-12T22:45:08.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d002a55-c93d-4bb9-85ed-0adfda5af69a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
292025-08-12T22:45:08.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d002a55-c93d-4bb9-85ed-0adfda5af69a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
302025-08-12T22:45:08.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d002a55-c93d-4bb9-85ed-0adfda5af69a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
312025-08-12T22:45:08.828ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 917 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = eabbb0c1-b889-453d-8289-0624b703556f response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
322025-08-12T22:45:09.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fad49507-07ec-48f9-8d35-787f2a0c3e5a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
332025-08-12T22:45:09.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fad49507-07ec-48f9-8d35-787f2a0c3e5a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
342025-08-12T22:45:09.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fad49507-07ec-48f9-8d35-787f2a0c3e5a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
352025-08-12T22:45:10.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0d63456b-c555-4b7f-b79b-be6455aecda6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
362025-08-12T22:45:10.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0d63456b-c555-4b7f-b79b-be6455aecda6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
372025-08-12T22:45:10.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0d63456b-c555-4b7f-b79b-be6455aecda6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
382025-08-12T22:45:11.040ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
392025-08-12T22:45:11.040ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
402025-08-12T22:45:11.040ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
412025-08-12T22:45:11.040ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 23 reason = Timeout
422025-08-12T22:45:11.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
432025-08-12T22:45:11.040ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
442025-08-12T22:45:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
452025-08-12T22:45:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
462025-08-12T22:45:11.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
472025-08-12T22:45:11.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
482025-08-12T22:45:11.042ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
492025-08-12T22:45:11.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
502025-08-12T22:45:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
512025-08-12T22:45:11.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.924519ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
522025-08-12T22:45:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
532025-08-12T22:45:11.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
542025-08-12T22:45:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
552025-08-12T22:45:11.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
562025-08-12T22:45:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
572025-08-12T22:45:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
582025-08-12T22:45:11.047ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
592025-08-12T22:45:11.047ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.508904ms iteration = 23 status = {"chicken_switches_updated":false}
602025-08-12T22:45:11.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
612025-08-12T22:45:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
622025-08-12T22:45:11.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
632025-08-12T22:45:11.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
642025-08-12T22:45:11.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
652025-08-12T22:45:11.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
662025-08-12T22:45:11.063ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
672025-08-12T22:45:11.063ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.304639ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
682025-08-12T22:45:11.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1228815c-cdb2-4c27-bbe2-c75e9cc972f9 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
692025-08-12T22:45:11.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1228815c-cdb2-4c27-bbe2-c75e9cc972f9 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
702025-08-12T22:45:11.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1228815c-cdb2-4c27-bbe2-c75e9cc972f9 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
712025-08-12T22:45:12.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1f90aa2b-f5fe-45f0-9f38-593b7b36f19d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
722025-08-12T22:45:12.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1f90aa2b-f5fe-45f0-9f38-593b7b36f19d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
732025-08-12T22:45:12.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1f90aa2b-f5fe-45f0-9f38-593b7b36f19d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
742025-08-12T22:45:13.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 66c51cda-a964-4bb8-a688-1c90f0870cf4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
752025-08-12T22:45:13.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 66c51cda-a964-4bb8-a688-1c90f0870cf4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
762025-08-12T22:45:13.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 66c51cda-a964-4bb8-a688-1c90f0870cf4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
772025-08-12T22:45:14.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0955691c-10d5-48ed-a570-10b7431125c0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
782025-08-12T22:45:14.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0955691c-10d5-48ed-a570-10b7431125c0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
792025-08-12T22:45:14.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0955691c-10d5-48ed-a570-10b7431125c0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
802025-08-12T22:45:15.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4bb20df6-ac2b-42da-ae0a-7da9bc0a90cf roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
812025-08-12T22:45:15.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4bb20df6-ac2b-42da-ae0a-7da9bc0a90cf resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
822025-08-12T22:45:15.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4bb20df6-ac2b-42da-ae0a-7da9bc0a90cf response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
832025-08-12T22:45:16.040ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 24 reason = Timeout
842025-08-12T22:45:16.040ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
852025-08-12T22:45:16.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
862025-08-12T22:45:16.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
872025-08-12T22:45:16.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
882025-08-12T22:45:16.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
892025-08-12T22:45:16.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
902025-08-12T22:45:16.048ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
912025-08-12T22:45:16.048ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.439923ms iteration = 24 status = {"chicken_switches_updated":false}
922025-08-12T22:45:16.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cbf82d10-7a8f-4d4e-aff9-63790535d519 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
932025-08-12T22:45:16.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cbf82d10-7a8f-4d4e-aff9-63790535d519 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
942025-08-12T22:45:16.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cbf82d10-7a8f-4d4e-aff9-63790535d519 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
952025-08-12T22:45:17.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f2546485-3aa0-4242-a062-de9205f5dac4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
962025-08-12T22:45:17.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f2546485-3aa0-4242-a062-de9205f5dac4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
972025-08-12T22:45:17.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f2546485-3aa0-4242-a062-de9205f5dac4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
982025-08-12T22:45:18.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3153eff6-58ef-4cf3-a551-2aaae5ed6d06 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
992025-08-12T22:45:18.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3153eff6-58ef-4cf3-a551-2aaae5ed6d06 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
1002025-08-12T22:45:18.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3153eff6-58ef-4cf3-a551-2aaae5ed6d06 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
1012025-08-12T22:45:18.829ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 999 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = aa96b014-1297-4716-a793-399b3d5ec4c4 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
1022025-08-12T22:45:19.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0ac100a9-4efa-4e6f-9662-cca60bcbe1bb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
1032025-08-12T22:45:19.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0ac100a9-4efa-4e6f-9662-cca60bcbe1bb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
1042025-08-12T22:45:19.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2619 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0ac100a9-4efa-4e6f-9662-cca60bcbe1bb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
1052025-08-12T22:45:20.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2d07a7ba-5798-4114-81c4-54dc07a4b15d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
1062025-08-12T22:45:20.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2d07a7ba-5798-4114-81c4-54dc07a4b15d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
1072025-08-12T22:45:20.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2d07a7ba-5798-4114-81c4-54dc07a4b15d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
1082025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
1092025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
1102025-08-12T22:45:21.039ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0
1112025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1122025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.92\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0"}
1132025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1142025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
1152025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1162025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
1172025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
1182025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1192025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1202025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
1212025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1222025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
1232025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
1242025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
1252025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
1262025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1272025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
1282025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
1292025-08-12T22:45:21.039ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-12 22:35:21.039729702 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1302025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1312025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1322025-08-12T22:45:21.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1332025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1342025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1352025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1362025-08-12T22:45:21.040ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3e3264d-303d-4ce7-a0ce-0090b10b154f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1123, tv_nsec: 281340417 } })
1372025-08-12T22:45:21.040ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("043b8097-0e38-4228-bada-dac70e518148.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26cd5275-57f5-4466-a94f-f96956f55588.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1123, tv_nsec: 281395287 } })
1382025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1392025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 6 reason = Timeout
1402025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
1412025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 10.93\u{b5}s iteration = 6 status = "Disabled"
1422025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
1432025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
1442025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1452025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
1462025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1472025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
1482025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1492025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1502025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
1512025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1522025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
1532025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1542025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1552025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 5 reason = Timeout
1562025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
1572025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1582025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1592025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
1602025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
1612025-08-12T22:45:21.040ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1622025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1632025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1642025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 25 reason = Timeout
1652025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
1662025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
1672025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1682025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
1692025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1702025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1712025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1722025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
1732025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1742025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
1752025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1762025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
1772025-08-12T22:45:21.040ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
1782025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1792025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 3 reason = Timeout
1802025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
1812025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 3 reason = Timeout
1822025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
1832025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
1842025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
1852025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 5 reason = Timeout
1862025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1872025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1882025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 8.96\u{b5}s iteration = 5 status = {"disabled":true,"errors":[],"sps":[]}
1892025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
1902025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 5 reason = Timeout
1912025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1922025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
1932025-08-12T22:45:21.040ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
1942025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1952025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1962025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1972025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1982025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1992025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2002025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
2012025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.456694ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
2022025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2032025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2042025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2052025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
2062025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2072025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2082025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2092025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2102025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2112025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2122025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
2132025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2142025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2152025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2162025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
2172025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
2182025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
2192025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.707007ms iteration = 3 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
2202025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
2212025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
2222025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
2232025-08-12T22:45:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
2242025-08-12T22:45:21.042ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1123, tv_nsec: 283196715 } })
2252025-08-12T22:45:21.042ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2262025-08-12T22:45:21.042ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
2272025-08-12T22:45:21.042ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-12 22:35:21.039729702 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2282025-08-12T22:45:21.042ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.801827ms iteration = 3 status = {"expiration":"2025-08-12T22:35:21.039729702Z","pruned":[]}
2292025-08-12T22:45:21.042ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1123, tv_nsec: 283690860 } })
2302025-08-12T22:45:21.042ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.052579ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2312025-08-12T22:45:21.042ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
2322025-08-12T22:45:21.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2332025-08-12T22:45:21.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2342025-08-12T22:45:21.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2352025-08-12T22:45:21.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2362025-08-12T22:45:21.044ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.270462ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
2372025-08-12T22:45:21.044ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2382025-08-12T22:45:21.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2392025-08-12T22:45:21.044ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2402025-08-12T22:45:21.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2412025-08-12T22:45:21.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2422025-08-12T22:45:21.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2432025-08-12T22:45:21.045ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2442025-08-12T22:45:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2452025-08-12T22:45:21.046ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2462025-08-12T22:45:21.046ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2472025-08-12T22:45:21.046ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2482025-08-12T22:45:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2492025-08-12T22:45:21.048ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2502025-08-12T22:45:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2512025-08-12T22:45:21.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2522025-08-12T22:45:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2532025-08-12T22:45:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2542025-08-12T22:45:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2552025-08-12T22:45:21.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2562025-08-12T22:45:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2572025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
2582025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2592025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2602025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2612025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2622025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2632025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2642025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2652025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2662025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
2672025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2682025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2692025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2702025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2712025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2722025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
2732025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2742025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2752025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 11.767145ms iteration = 5 status = {"errors":[],"requests_created_ok":[]}
2762025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2772025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2782025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2792025-08-12T22:45:21.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2802025-08-12T22:45:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2812025-08-12T22:45:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2822025-08-12T22:45:21.053ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2832025-08-12T22:45:21.053ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2842025-08-12T22:45:21.053ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2852025-08-12T22:45:21.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2862025-08-12T22:45:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2872025-08-12T22:45:21.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2882025-08-12T22:45:21.054ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1123, tv_nsec: 295737448 } })
2892025-08-12T22:45:21.054ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 14.105688ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2902025-08-12T22:45:21.054ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2912025-08-12T22:45:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2922025-08-12T22:45:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2932025-08-12T22:45:21.055ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
2942025-08-12T22:45:21.055ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2952025-08-12T22:45:21.055ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2962025-08-12T22:45:21.055ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2972025-08-12T22:45:21.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2982025-08-12T22:45:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2992025-08-12T22:45:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3002025-08-12T22:45:21.055ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3012025-08-12T22:45:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3022025-08-12T22:45:21.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
3032025-08-12T22:45:21.056ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 15.598743ms iteration = 25 status = {"chicken_switches_updated":false}
3042025-08-12T22:45:21.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3052025-08-12T22:45:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3062025-08-12T22:45:21.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3072025-08-12T22:45:21.057ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3082025-08-12T22:45:21.057ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
3092025-08-12T22:45:21.057ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 16.899136ms iteration = 3 status = {"by_rx":{},"error":null}
3102025-08-12T22:45:21.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3112025-08-12T22:45:21.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3122025-08-12T22:45:21.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3132025-08-12T22:45:21.060ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3142025-08-12T22:45:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3152025-08-12T22:45:21.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3162025-08-12T22:45:21.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3172025-08-12T22:45:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3182025-08-12T22:45:21.062ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3192025-08-12T22:45:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3202025-08-12T22:45:21.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3212025-08-12T22:45:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3222025-08-12T22:45:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3232025-08-12T22:45:21.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3242025-08-12T22:45:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3252025-08-12T22:45:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3262025-08-12T22:45:21.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3272025-08-12T22:45:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3282025-08-12T22:45:21.066ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3292025-08-12T22:45:21.066ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3302025-08-12T22:45:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3312025-08-12T22:45:21.067ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3322025-08-12T22:45:21.067ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 0 version = 2
3332025-08-12T22:45:21.067ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3342025-08-12T22:45:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
3352025-08-12T22:45:21.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3362025-08-12T22:45:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3372025-08-12T22:45:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3382025-08-12T22:45:21.100ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
3392025-08-12T22:45:21.100ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
3402025-08-12T22:45:21.100ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 60.1691ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
3412025-08-12T22:45:21.103ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3422025-08-12T22:45:21.103ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3432025-08-12T22:45:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3442025-08-12T22:45:21.105ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3452025-08-12T22:45:21.105ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
3462025-08-12T22:45:21.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3472025-08-12T22:45:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3482025-08-12T22:45:21.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3492025-08-12T22:45:21.106ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3502025-08-12T22:45:21.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3512025-08-12T22:45:21.107ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3522025-08-12T22:45:21.107ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3532025-08-12T22:45:21.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3542025-08-12T22:45:21.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3552025-08-12T22:45:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3562025-08-12T22:45:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3572025-08-12T22:45:21.109ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.994087ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3582025-08-12T22:45:21.110ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.184649ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
3592025-08-12T22:45:21.110ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 4 version = 2
3602025-08-12T22:45:21.110ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3612025-08-12T22:45:21.110ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-12 22:43:50.527483 UTC dns_group = external generation = 2
3622025-08-12T22:45:21.110ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 70.793775ms iteration = 3 status = {"generation":2}
3632025-08-12T22:45:21.114ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3642025-08-12T22:45:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3652025-08-12T22:45:21.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.079026ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
3662025-08-12T22:45:21.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3672025-08-12T22:45:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3682025-08-12T22:45:21.118ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3692025-08-12T22:45:21.118ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
3702025-08-12T22:45:21.118ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.813413ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3712025-08-12T22:45:21.118ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
3722025-08-12T22:45:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
3732025-08-12T22:45:21.120ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3742025-08-12T22:45:21.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
3752025-08-12T22:45:21.123ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
3762025-08-12T22:45:21.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
3772025-08-12T22:45:21.123ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
3782025-08-12T22:45:21.123ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.854613ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
3792025-08-12T22:45:21.123ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3802025-08-12T22:45:21.123ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3812025-08-12T22:45:21.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3822025-08-12T22:45:21.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3832025-08-12T22:45:21.125ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3842025-08-12T22:45:21.127ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
3852025-08-12T22:45:21.127ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.998434ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
3862025-08-12T22:45:21.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3872025-08-12T22:45:21.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3882025-08-12T22:45:21.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3892025-08-12T22:45:21.131ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
3902025-08-12T22:45:21.131ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3912025-08-12T22:45:21.131ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-12 22:43:49.909589 UTC dns_group = internal generation = 1
3922025-08-12T22:45:21.131ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 92.115683ms iteration = 3 status = {"generation":1}
3932025-08-12T22:45:21.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3942025-08-12T22:45:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3952025-08-12T22:45:21.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3962025-08-12T22:45:21.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3972025-08-12T22:45:21.137ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3982025-08-12T22:45:21.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
3992025-08-12T22:45:21.141ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4002025-08-12T22:45:21.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4012025-08-12T22:45:21.143ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 102.727847ms iteration = 5 status = 0
4022025-08-12T22:45:21.146ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 106.403314ms iteration = 7 status = {"physical_disks_added":0}
4032025-08-12T22:45:21.153ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-12T22:43:09.981233Z, time_modified: 2025-08-12T22:43:09.981233Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }) }
4042025-08-12T22:45:21.153ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 114.303152ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]}},"default_endpoint":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4052025-08-12T22:45:21.154ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
4062025-08-12T22:45:21.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
4072025-08-12T22:45:21.158ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 117.599274ms iteration = 3 status = {"dispatched":[],"errors":[],"glob_version":"180.0.0","globs_reprocessed":{},"no_receivers":[]}
4082025-08-12T22:45:21.161ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4092025-08-12T22:45:21.161ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
4102025-08-12T22:45:21.161ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.30669ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
4112025-08-12T22:45:21.164ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.939255ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
4122025-08-12T22:45:21.166ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4132025-08-12T22:45:21.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4142025-08-12T22:45:21.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.607952ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
4152025-08-12T22:45:21.168ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
4162025-08-12T22:45:21.168ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 127.889335ms iteration = 5 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
4172025-08-12T22:45:21.194ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4182025-08-12T22:45:21.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4192025-08-12T22:45:21.220ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4202025-08-12T22:45:21.224ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4212025-08-12T22:45:21.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4222025-08-12T22:45:21.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4232025-08-12T22:45:21.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4242025-08-12T22:45:21.242ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4252025-08-12T22:45:21.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4262025-08-12T22:45:21.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4272025-08-12T22:45:21.244ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4282025-08-12T22:45:21.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4292025-08-12T22:45:21.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4302025-08-12T22:45:21.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4312025-08-12T22:45:21.256ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
4322025-08-12T22:45:21.256ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4332025-08-12T22:45:21.257ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0115758-22e1-4f59-88b6-92eff4ce4ea5", "content-length": "26", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} })
4342025-08-12T22:45:21.257ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4352025-08-12T22:45:21.257ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
4362025-08-12T22:45:21.260ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4372025-08-12T22:45:21.260ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4382025-08-12T22:45:21.260ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d01fdecb-e320-44d5-aded-e12a8afb5239", "content-length": "372", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} })
4392025-08-12T22:45:21.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4402025-08-12T22:45:21.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4412025-08-12T22:45:21.332ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
4422025-08-12T22:45:21.332ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4432025-08-12T22:45:21.332ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5f724706-62f0-40d3-8029-31a795b90cbd", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} })
4442025-08-12T22:45:21.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4452025-08-12T22:45:21.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4462025-08-12T22:45:21.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4472025-08-12T22:45:21.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4482025-08-12T22:45:21.337ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
4492025-08-12T22:45:21.337ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4502025-08-12T22:45:21.337ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba6a035d-704b-4832-acc0-22dea1fa20dc", "content-length": "26", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} })
4512025-08-12T22:45:21.337ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4522025-08-12T22:45:21.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4532025-08-12T22:45:21.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4542025-08-12T22:45:21.339ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4552025-08-12T22:45:21.345ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4562025-08-12T22:45:21.345ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4572025-08-12T22:45:21.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5351b744-68fd-458d-919d-9cdb48ac449f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
4582025-08-12T22:45:21.345ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7d3f322e-1913-470c-bdca-136b43fbb8b8", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} })
4592025-08-12T22:45:21.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5351b744-68fd-458d-919d-9cdb48ac449f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
4602025-08-12T22:45:21.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5351b744-68fd-458d-919d-9cdb48ac449f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
4612025-08-12T22:45:21.347ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 307.211653ms iteration = 5 status = {}
4622025-08-12T22:45:21.353ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
4632025-08-12T22:45:21.353ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4642025-08-12T22:45:21.353ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8113c567-eb91-4df6-a46a-ffe88bfd9783", "content-length": "26", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} })
4652025-08-12T22:45:21.353ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4662025-08-12T22:45:21.357ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4672025-08-12T22:45:21.379ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
4682025-08-12T22:45:21.379ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 339.051365ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4692025-08-12T22:45:21.406ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4702025-08-12T22:45:21.406ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9a1db9af-39c4-4d09-86de-bb6a910ca842", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4712025-08-12T22:45:21.407ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4722025-08-12T22:45:21.409ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a7be1f21-e6fa-44ee-945c-53a36e2eaf0f", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4732025-08-12T22:45:21.409ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4742025-08-12T22:45:21.411ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4752025-08-12T22:45:21.411ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 371.589825ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4762025-08-12T22:45:21.420ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4772025-08-12T22:45:21.509ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4782025-08-12T22:45:21.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4792025-08-12T22:45:21.512ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 473.198801ms iteration = 5 status = null
4802025-08-12T22:45:21.542ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4812025-08-12T22:45:21.542ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9e8d39c-5f2a-49dd-bbfb-45c79a5909b6", "content-length": "691", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} })
4822025-08-12T22:45:21.543ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
4832025-08-12T22:45:21.543ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
4842025-08-12T22:45:21.543ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
4852025-08-12T22:45:21.544ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 504.352336ms iteration = 5 status = {}
4862025-08-12T22:45:21.553ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4872025-08-12T22:45:21.554ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1942c2b9-da8a-43c6-8365-b38765094a17", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4882025-08-12T22:45:21.554ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4892025-08-12T22:45:21.555ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f6f7734a-c9d9-4303-bec7-85ee4175c4aa", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4902025-08-12T22:45:21.555ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4912025-08-12T22:45:21.556ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 517.136841ms iteration = 5 status = {}
4922025-08-12T22:45:21.557ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "329f8688-7a62-4f3e-9450-cb7bdee49458", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4932025-08-12T22:45:21.557ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4942025-08-12T22:45:21.559ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4952025-08-12T22:45:21.559ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 520.164962ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4962025-08-12T22:45:21.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4972025-08-12T22:45:21.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4982025-08-12T22:45:21.601ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
4992025-08-12T22:45:21.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5002025-08-12T22:45:21.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5012025-08-12T22:45:21.615ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
5022025-08-12T22:45:21.615ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
5032025-08-12T22:45:21.615ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
5042025-08-12T22:45:21.615ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5052025-08-12T22:45:21.615ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5062025-08-12T22:45:21.615ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5072025-08-12T22:45:21.615ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5082025-08-12T22:45:21.615ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5092025-08-12T22:45:21.615ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5102025-08-12T22:45:21.615ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5112025-08-12T22:45:21.616ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
5122025-08-12T22:45:21.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5132025-08-12T22:45:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5142025-08-12T22:45:21.619ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
5152025-08-12T22:45:21.619ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5162025-08-12T22:45:21.723ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "417a6cd3-826e-4846-89a8-4f7b97f2b522", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} })
5172025-08-12T22:45:21.724ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
5182025-08-12T22:45:21.724ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5192025-08-12T22:45:21.724ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1266f58-1318-4c0c-95c7-c7a5de715b37", "content-length": "682", "date": "Tue, 12 Aug 2025 22:45:21 GMT"} })
5202025-08-12T22:45:21.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5212025-08-12T22:45:21.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5222025-08-12T22:45:21.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5232025-08-12T22:45:21.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5242025-08-12T22:45:21.836ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5252025-08-12T22:45:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5262025-08-12T22:45:21.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5272025-08-12T22:45:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5282025-08-12T22:45:21.845ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 804.874213ms iteration = 5 status = {}
5292025-08-12T22:45:22.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4ffb75b3-b734-4a2e-bc80-4dad2279138b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5302025-08-12T22:45:22.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4ffb75b3-b734-4a2e-bc80-4dad2279138b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5312025-08-12T22:45:22.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4ffb75b3-b734-4a2e-bc80-4dad2279138b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5322025-08-12T22:45:23.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7c923a69-834c-40a5-acbc-617b2950db6f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5332025-08-12T22:45:23.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7c923a69-834c-40a5-acbc-617b2950db6f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5342025-08-12T22:45:23.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7c923a69-834c-40a5-acbc-617b2950db6f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5352025-08-12T22:45:24.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 86349977-dfad-4a3c-9115-23719e120607 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5362025-08-12T22:45:24.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 86349977-dfad-4a3c-9115-23719e120607 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5372025-08-12T22:45:24.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 86349977-dfad-4a3c-9115-23719e120607 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5382025-08-12T22:45:25.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7fe589dc-05e1-4b8e-9da1-7b6eeb5906a8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5392025-08-12T22:45:25.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7fe589dc-05e1-4b8e-9da1-7b6eeb5906a8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5402025-08-12T22:45:25.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7fe589dc-05e1-4b8e-9da1-7b6eeb5906a8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5412025-08-12T22:45:26.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 26 reason = Timeout
5422025-08-12T22:45:26.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
5432025-08-12T22:45:26.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
5442025-08-12T22:45:26.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5452025-08-12T22:45:26.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
5462025-08-12T22:45:26.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
5472025-08-12T22:45:26.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
5482025-08-12T22:45:26.048ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
5492025-08-12T22:45:26.048ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.628175ms iteration = 26 status = {"chicken_switches_updated":false}
5502025-08-12T22:45:26.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d59c4eb-cbbb-4cbb-941e-3cad64fdc1f9 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5512025-08-12T22:45:26.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d59c4eb-cbbb-4cbb-941e-3cad64fdc1f9 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5522025-08-12T22:45:26.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d59c4eb-cbbb-4cbb-941e-3cad64fdc1f9 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5532025-08-12T22:45:27.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b7ff0dc9-857c-4bf1-a0de-4c830e86020b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5542025-08-12T22:45:27.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b7ff0dc9-857c-4bf1-a0de-4c830e86020b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5552025-08-12T22:45:27.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b7ff0dc9-857c-4bf1-a0de-4c830e86020b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5562025-08-12T22:45:28.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9f43bb0a-c349-44ca-b198-3501352daf82 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5572025-08-12T22:45:28.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9f43bb0a-c349-44ca-b198-3501352daf82 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5582025-08-12T22:45:28.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2666 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9f43bb0a-c349-44ca-b198-3501352daf82 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5592025-08-12T22:45:28.829ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 627 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 4ba0267a-fe2a-4411-bd77-0e18e9ff5aed response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
5602025-08-12T22:45:29.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 675aa59a-d3b7-4292-ac38-031d12885fcb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5612025-08-12T22:45:29.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 675aa59a-d3b7-4292-ac38-031d12885fcb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5622025-08-12T22:45:29.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 675aa59a-d3b7-4292-ac38-031d12885fcb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5632025-08-12T22:45:30.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0d6130de-bb04-4858-adac-eb5ef98a4ee1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5642025-08-12T22:45:30.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0d6130de-bb04-4858-adac-eb5ef98a4ee1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5652025-08-12T22:45:30.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0d6130de-bb04-4858-adac-eb5ef98a4ee1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5662025-08-12T22:45:31.041ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
5672025-08-12T22:45:31.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5682025-08-12T22:45:31.041ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
5692025-08-12T22:45:31.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 27 reason = Timeout
5702025-08-12T22:45:31.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5712025-08-12T22:45:31.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
5722025-08-12T22:45:31.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
5732025-08-12T22:45:31.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5742025-08-12T22:45:31.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5752025-08-12T22:45:31.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762025-08-12T22:45:31.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5772025-08-12T22:45:31.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5782025-08-12T22:45:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5792025-08-12T22:45:31.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.960609ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5802025-08-12T22:45:31.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5812025-08-12T22:45:31.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5822025-08-12T22:45:31.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
5832025-08-12T22:45:31.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
5842025-08-12T22:45:31.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5852025-08-12T22:45:31.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
5862025-08-12T22:45:31.047ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
5872025-08-12T22:45:31.047ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.321462ms iteration = 27 status = {"chicken_switches_updated":false}
5882025-08-12T22:45:31.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5892025-08-12T22:45:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5902025-08-12T22:45:31.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5912025-08-12T22:45:31.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
5922025-08-12T22:45:31.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5932025-08-12T22:45:31.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5942025-08-12T22:45:31.065ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
5952025-08-12T22:45:31.065ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.303928ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
5962025-08-12T22:45:31.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1e3dc8a8-562d-4811-b577-8bcd4ff091b0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5972025-08-12T22:45:31.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1e3dc8a8-562d-4811-b577-8bcd4ff091b0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5982025-08-12T22:45:31.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1e3dc8a8-562d-4811-b577-8bcd4ff091b0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
5992025-08-12T22:45:32.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e6269ef8-65b9-43b4-b215-bf6fbc176e1c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6002025-08-12T22:45:32.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e6269ef8-65b9-43b4-b215-bf6fbc176e1c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6012025-08-12T22:45:32.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e6269ef8-65b9-43b4-b215-bf6fbc176e1c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6022025-08-12T22:45:33.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b716b00-d3d2-40a8-9ef2-aa17c3255c43 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6032025-08-12T22:45:33.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b716b00-d3d2-40a8-9ef2-aa17c3255c43 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6042025-08-12T22:45:33.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b716b00-d3d2-40a8-9ef2-aa17c3255c43 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6052025-08-12T22:45:34.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 05f5adb3-3169-4125-86c2-9b2e827e7524 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6062025-08-12T22:45:34.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 05f5adb3-3169-4125-86c2-9b2e827e7524 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6072025-08-12T22:45:34.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 05f5adb3-3169-4125-86c2-9b2e827e7524 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6082025-08-12T22:45:35.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 59dae197-b4a1-4a9a-856b-7bd6db659383 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6092025-08-12T22:45:35.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 59dae197-b4a1-4a9a-856b-7bd6db659383 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6102025-08-12T22:45:35.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 59dae197-b4a1-4a9a-856b-7bd6db659383 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6112025-08-12T22:45:36.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 28 reason = Timeout
6122025-08-12T22:45:36.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
6132025-08-12T22:45:36.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
6142025-08-12T22:45:36.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6152025-08-12T22:45:36.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
6162025-08-12T22:45:36.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
6172025-08-12T22:45:36.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
6182025-08-12T22:45:36.048ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
6192025-08-12T22:45:36.048ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.11669ms iteration = 28 status = {"chicken_switches_updated":false}
6202025-08-12T22:45:36.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9654be0f-1728-4271-87f6-6ddd82ab3238 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6212025-08-12T22:45:36.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9654be0f-1728-4271-87f6-6ddd82ab3238 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6222025-08-12T22:45:36.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1786 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9654be0f-1728-4271-87f6-6ddd82ab3238 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6232025-08-12T22:45:37.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 23d31d80-a325-4517-827b-cef907bb0f6c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6242025-08-12T22:45:37.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 23d31d80-a325-4517-827b-cef907bb0f6c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6252025-08-12T22:45:37.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 23d31d80-a325-4517-827b-cef907bb0f6c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6262025-08-12T22:45:38.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d18e0718-6b7f-45ce-b1f9-2a4bb5e17dbc roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6272025-08-12T22:45:38.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d18e0718-6b7f-45ce-b1f9-2a4bb5e17dbc resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6282025-08-12T22:45:38.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d18e0718-6b7f-45ce-b1f9-2a4bb5e17dbc response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6292025-08-12T22:45:38.829ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 929 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 5257add1-5a90-4892-9b8a-0674115be1a9 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
6302025-08-12T22:45:39.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 77618fdf-b177-464e-b285-0cf8a16159e1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6312025-08-12T22:45:39.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 77618fdf-b177-464e-b285-0cf8a16159e1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6322025-08-12T22:45:39.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 77618fdf-b177-464e-b285-0cf8a16159e1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6332025-08-12T22:45:40.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 174c2a32-2ccf-49a6-8c31-2ecf2f1c36f3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6342025-08-12T22:45:40.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 174c2a32-2ccf-49a6-8c31-2ecf2f1c36f3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6352025-08-12T22:45:40.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2756 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 174c2a32-2ccf-49a6-8c31-2ecf2f1c36f3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6362025-08-12T22:45:41.041ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
6372025-08-12T22:45:41.041ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
6382025-08-12T22:45:41.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6392025-08-12T22:45:41.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 29 reason = Timeout
6402025-08-12T22:45:41.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6412025-08-12T22:45:41.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
6422025-08-12T22:45:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6432025-08-12T22:45:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
6442025-08-12T22:45:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6452025-08-12T22:45:41.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6462025-08-12T22:45:41.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6472025-08-12T22:45:41.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6482025-08-12T22:45:41.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6492025-08-12T22:45:41.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.798077ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6502025-08-12T22:45:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6512025-08-12T22:45:41.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6522025-08-12T22:45:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
6532025-08-12T22:45:41.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
6542025-08-12T22:45:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6552025-08-12T22:45:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
6562025-08-12T22:45:41.049ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
6572025-08-12T22:45:41.049ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.15722ms iteration = 29 status = {"chicken_switches_updated":false}
6582025-08-12T22:45:41.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6592025-08-12T22:45:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6602025-08-12T22:45:41.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6612025-08-12T22:45:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
6622025-08-12T22:45:41.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6632025-08-12T22:45:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6642025-08-12T22:45:41.067ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
6652025-08-12T22:45:41.067ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.274087ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
6662025-08-12T22:45:41.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dca2872e-12e6-4b2f-abf2-b7fde05610a8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6672025-08-12T22:45:41.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dca2872e-12e6-4b2f-abf2-b7fde05610a8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6682025-08-12T22:45:41.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dca2872e-12e6-4b2f-abf2-b7fde05610a8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6692025-08-12T22:45:42.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8d465642-8797-4e80-8c58-e67d0090bd40 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6702025-08-12T22:45:42.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8d465642-8797-4e80-8c58-e67d0090bd40 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6712025-08-12T22:45:42.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8d465642-8797-4e80-8c58-e67d0090bd40 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6722025-08-12T22:45:43.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c31eb715-0699-4f79-a510-75e47d326b17 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6732025-08-12T22:45:43.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c31eb715-0699-4f79-a510-75e47d326b17 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6742025-08-12T22:45:43.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c31eb715-0699-4f79-a510-75e47d326b17 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6752025-08-12T22:45:43.815ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:49063
6762025-08-12T22:45:43.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49063 req_id = 5e4b38f5-b95e-40f7-a1d9-782704a12705 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
6772025-08-12T22:45:43.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49063 req_id = 5e4b38f5-b95e-40f7-a1d9-782704a12705 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
6782025-08-12T22:45:43.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49063 req_id = 5e4b38f5-b95e-40f7-a1d9-782704a12705 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
6792025-08-12T22:45:43.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49063 req_id = 62c260b5-004b-491f-ab58-76d8cddc194b roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
6802025-08-12T22:45:43.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49063 req_id = 62c260b5-004b-491f-ab58-76d8cddc194b resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
6812025-08-12T22:45:43.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49063 req_id = 62c260b5-004b-491f-ab58-76d8cddc194b response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
6822025-08-12T22:45:44.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0d657108-2f65-42c5-a7a2-177ac01bcd52 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6832025-08-12T22:45:44.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0d657108-2f65-42c5-a7a2-177ac01bcd52 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6842025-08-12T22:45:44.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0d657108-2f65-42c5-a7a2-177ac01bcd52 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6852025-08-12T22:45:45.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f54b3715-b4d8-4844-94c2-928c41e33567 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6862025-08-12T22:45:45.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f54b3715-b4d8-4844-94c2-928c41e33567 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6872025-08-12T22:45:45.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f54b3715-b4d8-4844-94c2-928c41e33567 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6882025-08-12T22:45:46.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 30 reason = Timeout
6892025-08-12T22:45:46.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
6902025-08-12T22:45:46.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
6912025-08-12T22:45:46.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6922025-08-12T22:45:46.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
6932025-08-12T22:45:46.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
6942025-08-12T22:45:46.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
6952025-08-12T22:45:46.047ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
6962025-08-12T22:45:46.047ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.22387ms iteration = 30 status = {"chicken_switches_updated":false}
6972025-08-12T22:45:46.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f50bcacc-74eb-4d3f-bf19-acf104a4fbfe roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6982025-08-12T22:45:46.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f50bcacc-74eb-4d3f-bf19-acf104a4fbfe resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
6992025-08-12T22:45:46.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f50bcacc-74eb-4d3f-bf19-acf104a4fbfe response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
7002025-08-12T22:45:47.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5539ab2c-d166-4ba4-b675-2cd3bf00af70 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
7012025-08-12T22:45:47.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5539ab2c-d166-4ba4-b675-2cd3bf00af70 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
7022025-08-12T22:45:47.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5539ab2c-d166-4ba4-b675-2cd3bf00af70 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
7032025-08-12T22:45:48.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d4fbc98c-afc1-47b4-ae63-aea23cba29fb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
7042025-08-12T22:45:48.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d4fbc98c-afc1-47b4-ae63-aea23cba29fb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
7052025-08-12T22:45:48.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d4fbc98c-afc1-47b4-ae63-aea23cba29fb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
7062025-08-12T22:45:48.829ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 898 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 25c845a5-6052-4973-b4d0-6ed0361dd273 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
7072025-08-12T22:45:49.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 94a52f12-26c6-4e73-9378-376755afe82b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
7082025-08-12T22:45:49.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 94a52f12-26c6-4e73-9378-376755afe82b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
7092025-08-12T22:45:49.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 94a52f12-26c6-4e73-9378-376755afe82b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
7102025-08-12T22:45:50.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 23804501-e220-4de6-bf2f-aa152702cb83 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
7112025-08-12T22:45:50.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 23804501-e220-4de6-bf2f-aa152702cb83 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
7122025-08-12T22:45:50.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 23804501-e220-4de6-bf2f-aa152702cb83 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
7132025-08-12T22:45:51.039ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
7142025-08-12T22:45:51.039ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
7152025-08-12T22:45:51.039ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7162025-08-12T22:45:51.039ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
7172025-08-12T22:45:51.039ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
7182025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7192025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
7202025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 6 reason = Timeout
7212025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
7222025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
7232025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7242025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 12.33\u{b5}s iteration = 6 status = {"disabled":true,"errors":[],"sps":[]}
7252025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
7262025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
7272025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7282025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7292025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7302025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 6 reason = Timeout
7312025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
7322025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
7332025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7342025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
7352025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7362025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
7372025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7382025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
7392025-08-12T22:45:51.040ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
7402025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
7412025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7422025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
7432025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7442025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7452025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
7462025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7472025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 6 reason = Timeout
7482025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7492025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
7502025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
7512025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 31 reason = Timeout
7522025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
7532025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7542025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
7552025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
7562025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
7572025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7582025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7592025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7602025-08-12T22:45:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7612025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7622025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7632025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7642025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
7652025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7662025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7672025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7682025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7692025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
7702025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7712025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7722025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7732025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7742025-08-12T22:45:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7752025-08-12T22:45:51.043ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1153, tv_nsec: 284177183 } })
7762025-08-12T22:45:51.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7772025-08-12T22:45:51.043ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1153, tv_nsec: 284361834 } })
7782025-08-12T22:45:51.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7792025-08-12T22:45:51.043ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7802025-08-12T22:45:51.043ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
7812025-08-12T22:45:51.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7822025-08-12T22:45:51.043ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
7832025-08-12T22:45:51.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7842025-08-12T22:45:51.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.94992ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
7852025-08-12T22:45:51.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7862025-08-12T22:45:51.043ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.781688ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
7872025-08-12T22:45:51.043ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7882025-08-12T22:45:51.043ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7892025-08-12T22:45:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7902025-08-12T22:45:51.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7912025-08-12T22:45:51.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7922025-08-12T22:45:51.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7932025-08-12T22:45:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7942025-08-12T22:45:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7952025-08-12T22:45:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7962025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7972025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7982025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7992025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8002025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8012025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8022025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8032025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
8042025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8052025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8062025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8072025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
8082025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8092025-08-12T22:45:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8102025-08-12T22:45:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
8112025-08-12T22:45:51.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
8122025-08-12T22:45:51.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8132025-08-12T22:45:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
8142025-08-12T22:45:51.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8152025-08-12T22:45:51.051ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8162025-08-12T22:45:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8172025-08-12T22:45:51.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8182025-08-12T22:45:51.052ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1153, tv_nsec: 293382393 } })
8192025-08-12T22:45:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8202025-08-12T22:45:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8212025-08-12T22:45:51.052ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
8222025-08-12T22:45:51.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8232025-08-12T22:45:51.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8242025-08-12T22:45:51.052ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
8252025-08-12T22:45:51.052ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 12.130379ms iteration = 31 status = {"chicken_switches_updated":false}
8262025-08-12T22:45:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8272025-08-12T22:45:51.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8282025-08-12T22:45:51.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8292025-08-12T22:45:51.054ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8302025-08-12T22:45:51.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8312025-08-12T22:45:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8322025-08-12T22:45:51.056ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8332025-08-12T22:45:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8342025-08-12T22:45:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
8352025-08-12T22:45:51.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8362025-08-12T22:45:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8372025-08-12T22:45:51.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
8382025-08-12T22:45:51.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 39.094773ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
8392025-08-12T22:45:51.094ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8402025-08-12T22:45:51.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8412025-08-12T22:45:51.096ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.250312ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8422025-08-12T22:45:51.098ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.520814ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
8432025-08-12T22:45:51.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8442025-08-12T22:45:51.101ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8452025-08-12T22:45:51.101ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
8462025-08-12T22:45:51.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8472025-08-12T22:45:51.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8482025-08-12T22:45:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8492025-08-12T22:45:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8502025-08-12T22:45:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8512025-08-12T22:45:51.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8522025-08-12T22:45:51.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8532025-08-12T22:45:51.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.451173ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8542025-08-12T22:45:51.104ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8552025-08-12T22:45:51.104ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
8562025-08-12T22:45:51.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8572025-08-12T22:45:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8582025-08-12T22:45:51.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 64.342641ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8592025-08-12T22:45:51.105ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8602025-08-12T22:45:51.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8612025-08-12T22:45:51.107ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8622025-08-12T22:45:51.107ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8632025-08-12T22:45:51.107ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.25819ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8642025-08-12T22:45:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
8652025-08-12T22:45:51.109ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8662025-08-12T22:45:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8672025-08-12T22:45:51.110ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.30237ms iteration = 6 status = {"errors":[],"requests_created_ok":[]}
8682025-08-12T22:45:51.112ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
8692025-08-12T22:45:51.112ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8702025-08-12T22:45:51.112ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
8712025-08-12T22:45:51.112ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8722025-08-12T22:45:51.112ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b564ae9-9c12-4592-a29f-beb40556fe9f", "content-length": "26", "date": "Tue, 12 Aug 2025 22:45:51 GMT"} })
8732025-08-12T22:45:51.112ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f4ba83b-a0b5-4a24-b2e1-507f03fb95b8", "content-length": "26", "date": "Tue, 12 Aug 2025 22:45:51 GMT"} })
8742025-08-12T22:45:51.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8752025-08-12T22:45:51.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8762025-08-12T22:45:51.113ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8772025-08-12T22:45:51.113ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8782025-08-12T22:45:51.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8792025-08-12T22:45:51.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8802025-08-12T22:45:51.119ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
8812025-08-12T22:45:51.119ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8822025-08-12T22:45:51.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8832025-08-12T22:45:51.120ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "443489e5-4739-4640-b69d-db8a70b48acb", "content-length": "26", "date": "Tue, 12 Aug 2025 22:45:51 GMT"} })
8842025-08-12T22:45:51.120ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8852025-08-12T22:45:51.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8862025-08-12T22:45:51.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8872025-08-12T22:45:51.122ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
8882025-08-12T22:45:51.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
8892025-08-12T22:45:51.124ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8902025-08-12T22:45:51.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8912025-08-12T22:45:51.126ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.011394ms iteration = 6 status = 0
8922025-08-12T22:45:51.139ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8932025-08-12T22:45:51.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8942025-08-12T22:45:51.141ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.699048ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
8952025-08-12T22:45:51.147ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
8962025-08-12T22:45:51.147ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 106.503534ms iteration = 6 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
8972025-08-12T22:45:51.147ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8982025-08-12T22:45:51.147ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8992025-08-12T22:45:51.147ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.522195ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
9002025-08-12T22:45:51.201ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9012025-08-12T22:45:51.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9022025-08-12T22:45:51.202ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 162.904798ms iteration = 6 status = {}
9032025-08-12T22:45:51.203ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 164.008619ms iteration = 6 status = null
9042025-08-12T22:45:51.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9052025-08-12T22:45:51.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9062025-08-12T22:45:51.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9072025-08-12T22:45:51.208ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9082025-08-12T22:45:51.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9092025-08-12T22:45:51.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9102025-08-12T22:45:51.209ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 169.484713ms iteration = 8 status = {"physical_disks_added":0}
9112025-08-12T22:45:51.210ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9122025-08-12T22:45:51.212ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9132025-08-12T22:45:51.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9142025-08-12T22:45:51.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9152025-08-12T22:45:51.232ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
9162025-08-12T22:45:51.232ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9172025-08-12T22:45:51.233ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "886b499b-3822-4d28-979d-45db4c989593", "content-length": "372", "date": "Tue, 12 Aug 2025 22:45:51 GMT"} })
9182025-08-12T22:45:51.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9192025-08-12T22:45:51.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9202025-08-12T22:45:51.246ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
9212025-08-12T22:45:51.246ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
9222025-08-12T22:45:51.247ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ccbf6737-0a73-4200-b6e6-e6b132873e79", "date": "Tue, 12 Aug 2025 22:45:51 GMT"} })
9232025-08-12T22:45:51.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9242025-08-12T22:45:51.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9252025-08-12T22:45:51.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9262025-08-12T22:45:51.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9272025-08-12T22:45:51.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9282025-08-12T22:45:51.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9292025-08-12T22:45:51.254ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
9302025-08-12T22:45:51.254ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9312025-08-12T22:45:51.254ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b410c8cc-735b-43b8-96a7-7172efcd9cc6", "date": "Tue, 12 Aug 2025 22:45:51 GMT"} })
9322025-08-12T22:45:51.256ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 216.072589ms iteration = 6 status = {}
9332025-08-12T22:45:51.285ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9342025-08-12T22:45:51.285ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3de61afc-ddae-46d4-aa79-29d160129265", "content-length": "691", "date": "Tue, 12 Aug 2025 22:45:51 GMT"} })
9352025-08-12T22:45:51.285ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
9362025-08-12T22:45:51.285ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
9372025-08-12T22:45:51.285ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
9382025-08-12T22:45:51.288ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 247.594679ms iteration = 6 status = {}
9392025-08-12T22:45:51.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9402025-08-12T22:45:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9412025-08-12T22:45:51.315ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
9422025-08-12T22:45:51.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9432025-08-12T22:45:51.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9442025-08-12T22:45:51.422ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
9452025-08-12T22:45:51.422ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
9462025-08-12T22:45:51.422ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
9472025-08-12T22:45:51.422ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9482025-08-12T22:45:51.422ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9492025-08-12T22:45:51.422ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9502025-08-12T22:45:51.422ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9512025-08-12T22:45:51.422ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9522025-08-12T22:45:51.423ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9532025-08-12T22:45:51.423ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9542025-08-12T22:45:51.423ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
9552025-08-12T22:45:51.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9562025-08-12T22:45:51.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9572025-08-12T22:45:51.425ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
9582025-08-12T22:45:51.425ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9592025-08-12T22:45:51.534ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "75a94d77-677c-4891-9bca-b23156453744", "date": "Tue, 12 Aug 2025 22:45:51 GMT"} })
9602025-08-12T22:45:51.535ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
9612025-08-12T22:45:51.535ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9622025-08-12T22:45:51.535ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "74a30ee6-9b32-4385-ad67-3b09dcaf5a94", "content-length": "682", "date": "Tue, 12 Aug 2025 22:45:51 GMT"} })
9632025-08-12T22:45:51.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9642025-08-12T22:45:51.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9652025-08-12T22:45:51.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9662025-08-12T22:45:51.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9672025-08-12T22:45:51.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9682025-08-12T22:45:51.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9692025-08-12T22:45:51.657ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9702025-08-12T22:45:51.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9712025-08-12T22:45:51.664ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 624.482715ms iteration = 6 status = {}
9722025-08-12T22:45:51.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc6385ea-e622-446a-b8f7-c183dca0ba82 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9732025-08-12T22:45:51.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc6385ea-e622-446a-b8f7-c183dca0ba82 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9742025-08-12T22:45:51.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc6385ea-e622-446a-b8f7-c183dca0ba82 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9752025-08-12T22:45:52.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 17508cef-da01-48de-8e90-be39a5087644 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9762025-08-12T22:45:52.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 17508cef-da01-48de-8e90-be39a5087644 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9772025-08-12T22:45:52.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 17508cef-da01-48de-8e90-be39a5087644 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9782025-08-12T22:45:53.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8dbb3007-e154-41e7-b94e-4cf82e2a134d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9792025-08-12T22:45:53.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8dbb3007-e154-41e7-b94e-4cf82e2a134d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9802025-08-12T22:45:53.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8dbb3007-e154-41e7-b94e-4cf82e2a134d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9812025-08-12T22:45:54.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 54f75d7d-80a9-4251-a270-13b3075782ec roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9822025-08-12T22:45:54.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 54f75d7d-80a9-4251-a270-13b3075782ec resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9832025-08-12T22:45:54.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 54f75d7d-80a9-4251-a270-13b3075782ec response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9842025-08-12T22:45:55.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = db11ca4c-c988-4d59-8d07-748f53eb610f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9852025-08-12T22:45:55.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = db11ca4c-c988-4d59-8d07-748f53eb610f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9862025-08-12T22:45:55.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = db11ca4c-c988-4d59-8d07-748f53eb610f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9872025-08-12T22:45:56.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 32 reason = Timeout
9882025-08-12T22:45:56.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
9892025-08-12T22:45:56.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
9902025-08-12T22:45:56.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9912025-08-12T22:45:56.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
9922025-08-12T22:45:56.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
9932025-08-12T22:45:56.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
9942025-08-12T22:45:56.048ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
9952025-08-12T22:45:56.048ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.152ms iteration = 32 status = {"chicken_switches_updated":false}
9962025-08-12T22:45:56.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b4989854-2852-421e-80c8-a4633da67196 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9972025-08-12T22:45:56.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b4989854-2852-421e-80c8-a4633da67196 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9982025-08-12T22:45:56.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b4989854-2852-421e-80c8-a4633da67196 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
9992025-08-12T22:45:57.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c0b44a52-6373-46ae-b909-1225b4bfa1ba roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10002025-08-12T22:45:57.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c0b44a52-6373-46ae-b909-1225b4bfa1ba resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10012025-08-12T22:45:57.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c0b44a52-6373-46ae-b909-1225b4bfa1ba response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10022025-08-12T22:45:58.828ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 544 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 4b7bb5e4-9907-45c4-9790-27f7a4bfd665 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
10032025-08-12T22:45:58.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b30cd955-060f-47a5-9441-3f7bcdfae483 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10042025-08-12T22:45:58.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b30cd955-060f-47a5-9441-3f7bcdfae483 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10052025-08-12T22:45:58.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b30cd955-060f-47a5-9441-3f7bcdfae483 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10062025-08-12T22:45:59.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a96f16d7-582c-400b-a1b8-51cd0e11b91b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10072025-08-12T22:45:59.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a96f16d7-582c-400b-a1b8-51cd0e11b91b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10082025-08-12T22:45:59.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a96f16d7-582c-400b-a1b8-51cd0e11b91b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10092025-08-12T22:46:00.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9391cbbb-e959-49da-9122-c5de353cf85e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10102025-08-12T22:46:00.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9391cbbb-e959-49da-9122-c5de353cf85e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10112025-08-12T22:46:01.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9391cbbb-e959-49da-9122-c5de353cf85e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10122025-08-12T22:46:01.041ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
10132025-08-12T22:46:01.041ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
10142025-08-12T22:46:01.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 33 reason = Timeout
10152025-08-12T22:46:01.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10162025-08-12T22:46:01.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10172025-08-12T22:46:01.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10182025-08-12T22:46:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10192025-08-12T22:46:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10202025-08-12T22:46:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10212025-08-12T22:46:01.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10222025-08-12T22:46:01.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10232025-08-12T22:46:01.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10242025-08-12T22:46:01.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10252025-08-12T22:46:01.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.772917ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10262025-08-12T22:46:01.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
10272025-08-12T22:46:01.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10282025-08-12T22:46:01.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10292025-08-12T22:46:01.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10302025-08-12T22:46:01.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10312025-08-12T22:46:01.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10322025-08-12T22:46:01.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10332025-08-12T22:46:01.048ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
10342025-08-12T22:46:01.048ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.224101ms iteration = 33 status = {"chicken_switches_updated":false}
10352025-08-12T22:46:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10362025-08-12T22:46:01.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10372025-08-12T22:46:01.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
10382025-08-12T22:46:01.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10392025-08-12T22:46:01.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10402025-08-12T22:46:01.067ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
10412025-08-12T22:46:01.067ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.088925ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
10422025-08-12T22:46:02.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = edbd7ac2-6d89-44b0-b429-5dfd3068b799 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10432025-08-12T22:46:02.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = edbd7ac2-6d89-44b0-b429-5dfd3068b799 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10442025-08-12T22:46:02.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = edbd7ac2-6d89-44b0-b429-5dfd3068b799 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10452025-08-12T22:46:03.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cbf44e47-57a6-4cec-9b9f-8424c000f2e7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10462025-08-12T22:46:03.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cbf44e47-57a6-4cec-9b9f-8424c000f2e7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10472025-08-12T22:46:03.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cbf44e47-57a6-4cec-9b9f-8424c000f2e7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10482025-08-12T22:46:04.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 67c45420-301a-4266-bd09-ab09efb56b55 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10492025-08-12T22:46:04.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 67c45420-301a-4266-bd09-ab09efb56b55 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10502025-08-12T22:46:04.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 67c45420-301a-4266-bd09-ab09efb56b55 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10512025-08-12T22:46:05.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 223b75e2-d3b4-40f5-a41d-754f8741d53b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10522025-08-12T22:46:05.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 223b75e2-d3b4-40f5-a41d-754f8741d53b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10532025-08-12T22:46:05.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 223b75e2-d3b4-40f5-a41d-754f8741d53b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10542025-08-12T22:46:06.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 34 reason = Timeout
10552025-08-12T22:46:06.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10562025-08-12T22:46:06.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10572025-08-12T22:46:06.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10582025-08-12T22:46:06.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
10592025-08-12T22:46:06.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10602025-08-12T22:46:06.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10612025-08-12T22:46:06.049ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
10622025-08-12T22:46:06.049ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.515084ms iteration = 34 status = {"chicken_switches_updated":false}
10632025-08-12T22:46:06.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3ac77568-5879-4f18-a386-5bdcbcbb1019 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10642025-08-12T22:46:06.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3ac77568-5879-4f18-a386-5bdcbcbb1019 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10652025-08-12T22:46:06.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3ac77568-5879-4f18-a386-5bdcbcbb1019 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10662025-08-12T22:46:07.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f70ed374-1ae6-4865-9637-c0ac8f140463 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10672025-08-12T22:46:07.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f70ed374-1ae6-4865-9637-c0ac8f140463 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10682025-08-12T22:46:07.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f70ed374-1ae6-4865-9637-c0ac8f140463 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10692025-08-12T22:46:08.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9b532eb3-14a6-4b6a-abd4-ed0bf6ff05e1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10702025-08-12T22:46:08.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9b532eb3-14a6-4b6a-abd4-ed0bf6ff05e1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10712025-08-12T22:46:08.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9b532eb3-14a6-4b6a-abd4-ed0bf6ff05e1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10722025-08-12T22:46:08.829ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 870 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 05d0f1c0-dedd-49be-9be3-d72d95bcf267 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
10732025-08-12T22:46:09.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c2336d64-5351-413f-a6af-d8fdb4d28b48 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10742025-08-12T22:46:09.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c2336d64-5351-413f-a6af-d8fdb4d28b48 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10752025-08-12T22:46:09.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c2336d64-5351-413f-a6af-d8fdb4d28b48 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10762025-08-12T22:46:10.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 78332eb6-7324-47b9-8b6d-c42b913602d2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10772025-08-12T22:46:10.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 78332eb6-7324-47b9-8b6d-c42b913602d2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10782025-08-12T22:46:10.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 78332eb6-7324-47b9-8b6d-c42b913602d2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
10792025-08-12T22:46:11.041ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
10802025-08-12T22:46:11.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10812025-08-12T22:46:11.041ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
10822025-08-12T22:46:11.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 35 reason = Timeout
10832025-08-12T22:46:11.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10842025-08-12T22:46:11.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10852025-08-12T22:46:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10862025-08-12T22:46:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10872025-08-12T22:46:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10882025-08-12T22:46:11.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10892025-08-12T22:46:11.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10902025-08-12T22:46:11.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10912025-08-12T22:46:11.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10922025-08-12T22:46:11.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.967599ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10932025-08-12T22:46:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
10942025-08-12T22:46:11.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10952025-08-12T22:46:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10962025-08-12T22:46:11.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10972025-08-12T22:46:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10982025-08-12T22:46:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10992025-08-12T22:46:11.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11002025-08-12T22:46:11.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11012025-08-12T22:46:11.049ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
11022025-08-12T22:46:11.049ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.122779ms iteration = 35 status = {"chicken_switches_updated":false}
11032025-08-12T22:46:11.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11042025-08-12T22:46:11.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
11052025-08-12T22:46:11.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11062025-08-12T22:46:11.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11072025-08-12T22:46:11.066ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
11082025-08-12T22:46:11.066ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.901875ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
11092025-08-12T22:46:11.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7066520f-adbb-4e64-8155-b1569d7aa313 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11102025-08-12T22:46:11.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7066520f-adbb-4e64-8155-b1569d7aa313 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11112025-08-12T22:46:11.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7066520f-adbb-4e64-8155-b1569d7aa313 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11122025-08-12T22:46:12.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5bfb31dc-8158-4d18-8f37-278c234a3152 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11132025-08-12T22:46:12.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5bfb31dc-8158-4d18-8f37-278c234a3152 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11142025-08-12T22:46:12.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5bfb31dc-8158-4d18-8f37-278c234a3152 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11152025-08-12T22:46:13.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 47138a3f-1e49-4bb5-8c1c-65d29ebad13b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11162025-08-12T22:46:13.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 47138a3f-1e49-4bb5-8c1c-65d29ebad13b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11172025-08-12T22:46:13.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 47138a3f-1e49-4bb5-8c1c-65d29ebad13b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11182025-08-12T22:46:13.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49063 req_id = 1ac1e75b-7796-41bc-ae46-4380295c5864 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
11192025-08-12T22:46:13.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49063 req_id = 1ac1e75b-7796-41bc-ae46-4380295c5864 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
11202025-08-12T22:46:13.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49063 req_id = 1ac1e75b-7796-41bc-ae46-4380295c5864 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
11212025-08-12T22:46:13.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49063 req_id = ef3e81d0-ac55-4260-8d15-b951e1bbc4ed roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
11222025-08-12T22:46:13.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49063 req_id = ef3e81d0-ac55-4260-8d15-b951e1bbc4ed resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
11232025-08-12T22:46:13.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49063 req_id = ef3e81d0-ac55-4260-8d15-b951e1bbc4ed response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
11242025-08-12T22:46:14.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 738459bd-efdf-4ba4-8739-8f51bf058200 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11252025-08-12T22:46:14.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 738459bd-efdf-4ba4-8739-8f51bf058200 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11262025-08-12T22:46:14.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 738459bd-efdf-4ba4-8739-8f51bf058200 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11272025-08-12T22:46:15.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 43e1f3aa-9b43-429d-b28b-0a82f4bf6e3e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11282025-08-12T22:46:15.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 43e1f3aa-9b43-429d-b28b-0a82f4bf6e3e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11292025-08-12T22:46:15.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 43e1f3aa-9b43-429d-b28b-0a82f4bf6e3e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11302025-08-12T22:46:16.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 36 reason = Timeout
11312025-08-12T22:46:16.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11322025-08-12T22:46:16.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11332025-08-12T22:46:16.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11342025-08-12T22:46:16.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
11352025-08-12T22:46:16.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11362025-08-12T22:46:16.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11372025-08-12T22:46:16.048ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
11382025-08-12T22:46:16.048ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.789756ms iteration = 36 status = {"chicken_switches_updated":false}
11392025-08-12T22:46:16.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 10e84ef7-5326-49da-b7d8-df5b16dd778e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11402025-08-12T22:46:16.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 10e84ef7-5326-49da-b7d8-df5b16dd778e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11412025-08-12T22:46:16.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 10e84ef7-5326-49da-b7d8-df5b16dd778e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11422025-08-12T22:46:17.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 96b2a48c-5eb7-45c5-9f9f-4a55fe3713c3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11432025-08-12T22:46:17.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 96b2a48c-5eb7-45c5-9f9f-4a55fe3713c3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11442025-08-12T22:46:17.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 96b2a48c-5eb7-45c5-9f9f-4a55fe3713c3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11452025-08-12T22:46:18.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f6052da5-2792-414c-b9bb-7050b25348f5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11462025-08-12T22:46:18.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f6052da5-2792-414c-b9bb-7050b25348f5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11472025-08-12T22:46:18.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f6052da5-2792-414c-b9bb-7050b25348f5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11482025-08-12T22:46:18.829ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 542 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 0e76bb74-2b69-4475-952f-283ba57c0391 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
11492025-08-12T22:46:19.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c964f907-7ee8-4476-b023-6b2b7729ce8f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11502025-08-12T22:46:19.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c964f907-7ee8-4476-b023-6b2b7729ce8f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11512025-08-12T22:46:19.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c964f907-7ee8-4476-b023-6b2b7729ce8f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11522025-08-12T22:46:20.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9c97e2e5-2582-4115-b2b8-c323dd40b4de roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11532025-08-12T22:46:20.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9c97e2e5-2582-4115-b2b8-c323dd40b4de resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11542025-08-12T22:46:20.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9c97e2e5-2582-4115-b2b8-c323dd40b4de response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
11552025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
11562025-08-12T22:46:21.040ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0
11572025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.19\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0"}
11582025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
11592025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
11602025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
11612025-08-12T22:46:21.040ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-12 22:36:21.040332488 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
11622025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11632025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
11642025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
11652025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
11662025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11672025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
11682025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
11692025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
11702025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11712025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
11722025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
11732025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11742025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
11752025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
11762025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11772025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
11782025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11792025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
11802025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11812025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11822025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11832025-08-12T22:46:21.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11842025-08-12T22:46:21.041ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3e3264d-303d-4ce7-a0ce-0090b10b154f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1183, tv_nsec: 281551755 } })
11852025-08-12T22:46:21.041ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("043b8097-0e38-4228-bada-dac70e518148.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26cd5275-57f5-4466-a94f-f96956f55588.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1183, tv_nsec: 281630656 } })
11862025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
11872025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
11882025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
11892025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11902025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11912025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 4 reason = Timeout
11922025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11932025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
11942025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
11952025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
11962025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
11972025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
11982025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11992025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
12002025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
12012025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12022025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 7 reason = Timeout
12032025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
12042025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12052025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
12062025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12072025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
12082025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12092025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
12102025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 4 reason = Timeout
12112025-08-12T22:46:21.041ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
12122025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
12132025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12142025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
12152025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
12162025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
12172025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
12182025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12192025-08-12T22:46:21.041ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
12202025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
12212025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
12222025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12232025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 7 reason = Timeout
12242025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
12252025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 10.09\u{b5}s iteration = 7 status = "Disabled"
12262025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 37 reason = Timeout
12272025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
12282025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
12292025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
12302025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
12312025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12322025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
12332025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12342025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 7 reason = Timeout
12352025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
12362025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
12372025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12382025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
12392025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12402025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 7 reason = Timeout
12412025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 23.55\u{b5}s iteration = 7 status = {"disabled":true,"errors":[],"sps":[]}
12422025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
12432025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.221612ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
12442025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
12452025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12462025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12472025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
12482025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
12492025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12502025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.417164ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
12512025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12522025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12532025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12542025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
12552025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
12562025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12572025-08-12T22:46:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
12582025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
12592025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12602025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12612025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
12622025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12632025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12642025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12652025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
12662025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12672025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12682025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12692025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12702025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12712025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12722025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12732025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12742025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12752025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12762025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12772025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12782025-08-12T22:46:21.042ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12792025-08-12T22:46:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12802025-08-12T22:46:21.043ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12812025-08-12T22:46:21.043ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12822025-08-12T22:46:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12832025-08-12T22:46:21.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12842025-08-12T22:46:21.043ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12852025-08-12T22:46:21.044ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-12 22:36:21.040332488 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
12862025-08-12T22:46:21.044ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.804307ms iteration = 4 status = {"expiration":"2025-08-12T22:36:21.040332488Z","pruned":[]}
12872025-08-12T22:46:21.044ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12882025-08-12T22:46:21.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12892025-08-12T22:46:21.044ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.738377ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12902025-08-12T22:46:21.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12912025-08-12T22:46:21.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12922025-08-12T22:46:21.044ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1183, tv_nsec: 285166340 } })
12932025-08-12T22:46:21.045ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
12942025-08-12T22:46:21.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12952025-08-12T22:46:21.046ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12962025-08-12T22:46:21.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12972025-08-12T22:46:21.046ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12982025-08-12T22:46:21.046ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
12992025-08-12T22:46:21.047ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13002025-08-12T22:46:21.047ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
13012025-08-12T22:46:21.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13022025-08-12T22:46:21.047ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.779886ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
13032025-08-12T22:46:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
13042025-08-12T22:46:21.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13052025-08-12T22:46:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13062025-08-12T22:46:21.047ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 6.640105ms iteration = 7 status = {"errors":[],"requests_created_ok":[]}
13072025-08-12T22:46:21.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13082025-08-12T22:46:21.048ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
13092025-08-12T22:46:21.048ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
13102025-08-12T22:46:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 7.389043ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
13112025-08-12T22:46:21.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13122025-08-12T22:46:21.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13132025-08-12T22:46:21.048ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13142025-08-12T22:46:21.049ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
13152025-08-12T22:46:21.049ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 7.902127ms iteration = 4 status = {"by_rx":{},"error":null}
13162025-08-12T22:46:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13172025-08-12T22:46:21.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.241091ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
13182025-08-12T22:46:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13192025-08-12T22:46:21.049ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 8.584834ms iteration = 4 status = {"dispatched":[],"errors":[],"glob_version":"180.0.0","globs_reprocessed":{},"no_receivers":[]}
13202025-08-12T22:46:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13212025-08-12T22:46:21.050ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13222025-08-12T22:46:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13232025-08-12T22:46:21.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13242025-08-12T22:46:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13252025-08-12T22:46:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13262025-08-12T22:46:21.050ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13272025-08-12T22:46:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13282025-08-12T22:46:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13292025-08-12T22:46:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.11474ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13302025-08-12T22:46:21.051ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13312025-08-12T22:46:21.051ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13322025-08-12T22:46:21.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13332025-08-12T22:46:21.052ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13342025-08-12T22:46:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13352025-08-12T22:46:21.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13362025-08-12T22:46:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13372025-08-12T22:46:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13382025-08-12T22:46:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13392025-08-12T22:46:21.052ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13402025-08-12T22:46:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13412025-08-12T22:46:21.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13422025-08-12T22:46:21.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13432025-08-12T22:46:21.052ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13442025-08-12T22:46:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13452025-08-12T22:46:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13462025-08-12T22:46:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13472025-08-12T22:46:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13482025-08-12T22:46:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
13492025-08-12T22:46:21.053ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13502025-08-12T22:46:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13512025-08-12T22:46:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13522025-08-12T22:46:21.054ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1183, tv_nsec: 294554292 } })
13532025-08-12T22:46:21.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13542025-08-12T22:46:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
13552025-08-12T22:46:21.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
13562025-08-12T22:46:21.054ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13572025-08-12T22:46:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13582025-08-12T22:46:21.054ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13592025-08-12T22:46:21.054ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
13602025-08-12T22:46:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13612025-08-12T22:46:21.054ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13622025-08-12T22:46:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
13632025-08-12T22:46:21.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13642025-08-12T22:46:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13652025-08-12T22:46:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13662025-08-12T22:46:21.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13672025-08-12T22:46:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13682025-08-12T22:46:21.055ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13692025-08-12T22:46:21.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
13702025-08-12T22:46:21.056ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 15.631103ms iteration = 37 status = {"chicken_switches_updated":false}
13712025-08-12T22:46:21.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13722025-08-12T22:46:21.058ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1183, tv_nsec: 298691783 } })
13732025-08-12T22:46:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13742025-08-12T22:46:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13752025-08-12T22:46:21.058ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13762025-08-12T22:46:21.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13772025-08-12T22:46:21.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13782025-08-12T22:46:21.058ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
13792025-08-12T22:46:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13802025-08-12T22:46:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13812025-08-12T22:46:21.058ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13822025-08-12T22:46:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13832025-08-12T22:46:21.059ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13842025-08-12T22:46:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13852025-08-12T22:46:21.059ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13862025-08-12T22:46:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13872025-08-12T22:46:21.059ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
13882025-08-12T22:46:21.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13892025-08-12T22:46:21.059ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 18.543872ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
13902025-08-12T22:46:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13912025-08-12T22:46:21.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13922025-08-12T22:46:21.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13932025-08-12T22:46:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13942025-08-12T22:46:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13952025-08-12T22:46:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13962025-08-12T22:46:21.061ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13972025-08-12T22:46:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13982025-08-12T22:46:21.061ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13992025-08-12T22:46:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14002025-08-12T22:46:21.062ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14012025-08-12T22:46:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14022025-08-12T22:46:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14032025-08-12T22:46:21.064ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14042025-08-12T22:46:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14052025-08-12T22:46:21.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14062025-08-12T22:46:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
14072025-08-12T22:46:21.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14082025-08-12T22:46:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14092025-08-12T22:46:21.086ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 45.441075ms iteration = 9 status = {"physical_disks_added":0}
14102025-08-12T22:46:21.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14112025-08-12T22:46:21.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14122025-08-12T22:46:21.096ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14132025-08-12T22:46:21.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14142025-08-12T22:46:21.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14152025-08-12T22:46:21.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14162025-08-12T22:46:21.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14172025-08-12T22:46:21.100ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
14182025-08-12T22:46:21.100ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.613515ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
14192025-08-12T22:46:21.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14202025-08-12T22:46:21.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14212025-08-12T22:46:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14222025-08-12T22:46:21.104ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14232025-08-12T22:46:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14242025-08-12T22:46:21.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14252025-08-12T22:46:21.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14262025-08-12T22:46:21.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.348251ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
14272025-08-12T22:46:21.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14282025-08-12T22:46:21.110ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14292025-08-12T22:46:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14302025-08-12T22:46:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14312025-08-12T22:46:21.112ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
14322025-08-12T22:46:21.112ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
14332025-08-12T22:46:21.112ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
14342025-08-12T22:46:21.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14352025-08-12T22:46:21.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14362025-08-12T22:46:21.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14372025-08-12T22:46:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14382025-08-12T22:46:21.115ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14392025-08-12T22:46:21.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14402025-08-12T22:46:21.118ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14412025-08-12T22:46:21.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
14422025-08-12T22:46:21.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14432025-08-12T22:46:21.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14442025-08-12T22:46:21.120ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
14452025-08-12T22:46:21.120ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
14462025-08-12T22:46:21.120ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.570021ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
14472025-08-12T22:46:21.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14482025-08-12T22:46:21.121ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14492025-08-12T22:46:21.121ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
14502025-08-12T22:46:21.121ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.242177ms iteration = 7 status = 0
14512025-08-12T22:46:21.121ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
14522025-08-12T22:46:21.121ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
14532025-08-12T22:46:21.121ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14542025-08-12T22:46:21.121ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14552025-08-12T22:46:21.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14562025-08-12T22:46:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14572025-08-12T22:46:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14582025-08-12T22:46:21.122ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14592025-08-12T22:46:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14602025-08-12T22:46:21.122ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14612025-08-12T22:46:21.122ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14622025-08-12T22:46:21.122ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 81.068365ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14632025-08-12T22:46:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14642025-08-12T22:46:21.123ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 81.978864ms iteration = 3 status = {"nsuccess":5}
14652025-08-12T22:46:21.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14662025-08-12T22:46:21.124ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14672025-08-12T22:46:21.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14682025-08-12T22:46:21.126ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14692025-08-12T22:46:21.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14702025-08-12T22:46:21.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14712025-08-12T22:46:21.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14722025-08-12T22:46:21.129ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14732025-08-12T22:46:21.129ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14742025-08-12T22:46:21.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14752025-08-12T22:46:21.131ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
14762025-08-12T22:46:21.131ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 89.875621ms iteration = 7 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
14772025-08-12T22:46:21.149ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.449124ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
14782025-08-12T22:46:21.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 125.836664ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14792025-08-12T22:46:21.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 128.009365ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14802025-08-12T22:46:21.171ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
14812025-08-12T22:46:21.171ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 0 version = 2
14822025-08-12T22:46:21.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14832025-08-12T22:46:21.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14842025-08-12T22:46:21.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14852025-08-12T22:46:21.176ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
14862025-08-12T22:46:21.176ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
14872025-08-12T22:46:21.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14882025-08-12T22:46:21.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14892025-08-12T22:46:21.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14902025-08-12T22:46:21.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14912025-08-12T22:46:21.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14922025-08-12T22:46:21.178ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14932025-08-12T22:46:21.178ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 4 version = 2
14942025-08-12T22:46:21.179ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
14952025-08-12T22:46:21.179ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-12 22:43:50.527483 UTC dns_group = external generation = 2
14962025-08-12T22:46:21.179ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 138.65367ms iteration = 4 status = {"generation":2}
14972025-08-12T22:46:21.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14982025-08-12T22:46:21.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14992025-08-12T22:46:21.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15002025-08-12T22:46:21.184ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-12T22:43:09.981233Z, time_modified: 2025-08-12T22:43:09.981233Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }) }
15012025-08-12T22:46:21.184ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 143.964212ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]}},"default_endpoint":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15022025-08-12T22:46:21.187ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
15032025-08-12T22:46:21.187ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15042025-08-12T22:46:21.187ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-12 22:43:49.909589 UTC dns_group = internal generation = 1
15052025-08-12T22:46:21.187ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 146.88981ms iteration = 4 status = {"generation":1}
15062025-08-12T22:46:21.188ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15072025-08-12T22:46:21.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15082025-08-12T22:46:21.238ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
15092025-08-12T22:46:21.238ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15102025-08-12T22:46:21.238ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da995613-076b-44f7-9028-325a18fa75bd", "content-length": "26", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} })
15112025-08-12T22:46:21.238ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15122025-08-12T22:46:21.239ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
15132025-08-12T22:46:21.239ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15142025-08-12T22:46:21.239ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b63e3dc3-d34b-4b52-8819-439c23a941a8", "content-length": "26", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} })
15152025-08-12T22:46:21.239ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15162025-08-12T22:46:21.240ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
15172025-08-12T22:46:21.241ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15182025-08-12T22:46:21.247ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15192025-08-12T22:46:21.253ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15202025-08-12T22:46:21.253ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15212025-08-12T22:46:21.254ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5842d264-ea4c-4974-94bd-1f9b663ec7eb", "content-length": "372", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} })
15222025-08-12T22:46:21.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15232025-08-12T22:46:21.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15242025-08-12T22:46:21.268ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
15252025-08-12T22:46:21.268ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15262025-08-12T22:46:21.268ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "51db38bc-151a-4b7d-9a51-d6128c5d4e3d", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} })
15272025-08-12T22:46:21.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15282025-08-12T22:46:21.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15292025-08-12T22:46:21.307ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
15302025-08-12T22:46:21.307ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 265.764577ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
15312025-08-12T22:46:21.311ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15322025-08-12T22:46:21.316ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15332025-08-12T22:46:21.317ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3aeb1fd4-4a9e-419f-b240-c1682186f3a5", "content-length": "691", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} })
15342025-08-12T22:46:21.317ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
15352025-08-12T22:46:21.317ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
15362025-08-12T22:46:21.317ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
15372025-08-12T22:46:21.318ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 277.359351ms iteration = 7 status = {}
15382025-08-12T22:46:21.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2158e101-29c2-4024-ac82-f07a00432a0a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
15392025-08-12T22:46:21.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2158e101-29c2-4024-ac82-f07a00432a0a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
15402025-08-12T22:46:21.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2158e101-29c2-4024-ac82-f07a00432a0a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
15412025-08-12T22:46:21.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15422025-08-12T22:46:21.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15432025-08-12T22:46:21.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15442025-08-12T22:46:21.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15452025-08-12T22:46:21.376ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15462025-08-12T22:46:21.376ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15472025-08-12T22:46:21.377ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "19f6af50-a8d5-4268-b912-c8c99561af15", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} })
15482025-08-12T22:46:21.379ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 337.874194ms iteration = 7 status = {}
15492025-08-12T22:46:21.380ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
15502025-08-12T22:46:21.380ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15512025-08-12T22:46:21.380ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44a75045-9803-4d41-a6bd-4941fc1f86f4", "content-length": "26", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} })
15522025-08-12T22:46:21.380ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15532025-08-12T22:46:21.382ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15542025-08-12T22:46:21.519ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15552025-08-12T22:46:21.519ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15562025-08-12T22:46:21.520ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8a203b8d-2bdd-47e3-9bd9-fe52c130337a", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15572025-08-12T22:46:21.520ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15582025-08-12T22:46:21.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15592025-08-12T22:46:21.521ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "482afb56-ac08-4751-90d6-d5686a47e55f", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15602025-08-12T22:46:21.521ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15612025-08-12T22:46:21.521ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 481.445252ms iteration = 7 status = null
15622025-08-12T22:46:21.523ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15632025-08-12T22:46:21.523ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 482.995177ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
15642025-08-12T22:46:21.540ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 500.030994ms iteration = 7 status = {}
15652025-08-12T22:46:21.547ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
15662025-08-12T22:46:21.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15672025-08-12T22:46:21.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15682025-08-12T22:46:21.614ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
15692025-08-12T22:46:21.615ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e9fe3619-66e5-431a-a02b-fa5864fd9238", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
15702025-08-12T22:46:21.615ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
15712025-08-12T22:46:21.615ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
15722025-08-12T22:46:21.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15732025-08-12T22:46:21.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15742025-08-12T22:46:21.616ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "02c6693d-98c6-48a0-8ec8-2457195a970a", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
15752025-08-12T22:46:21.616ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
15762025-08-12T22:46:21.618ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7a2c1b9c-e09f-46ee-8e55-b5f8198a6328", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
15772025-08-12T22:46:21.618ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
15782025-08-12T22:46:21.620ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
15792025-08-12T22:46:21.620ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 579.895248ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
15802025-08-12T22:46:21.629ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
15812025-08-12T22:46:21.629ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
15822025-08-12T22:46:21.629ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15832025-08-12T22:46:21.629ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15842025-08-12T22:46:21.629ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15852025-08-12T22:46:21.629ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15862025-08-12T22:46:21.629ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15872025-08-12T22:46:21.629ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15882025-08-12T22:46:21.629ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15892025-08-12T22:46:21.629ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15902025-08-12T22:46:21.629ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
15912025-08-12T22:46:21.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15922025-08-12T22:46:21.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15932025-08-12T22:46:21.632ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
15942025-08-12T22:46:21.632ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15952025-08-12T22:46:21.734ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8496fe4d-a325-4f2b-84f3-d92e3d4f273a", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} })
15962025-08-12T22:46:21.734ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
15972025-08-12T22:46:21.734ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15982025-08-12T22:46:21.735ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bcab3e7-1957-4887-b5fd-e6d3de738d02", "content-length": "682", "date": "Tue, 12 Aug 2025 22:46:21 GMT"} })
15992025-08-12T22:46:21.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16002025-08-12T22:46:21.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16012025-08-12T22:46:21.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16022025-08-12T22:46:21.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16032025-08-12T22:46:21.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16042025-08-12T22:46:21.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16052025-08-12T22:46:21.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16062025-08-12T22:46:21.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16072025-08-12T22:46:21.864ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 823.163423ms iteration = 7 status = {}
16082025-08-12T22:46:22.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bf747462-9ca8-4d13-bda1-79bbdb2d2bea roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16092025-08-12T22:46:22.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bf747462-9ca8-4d13-bda1-79bbdb2d2bea resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16102025-08-12T22:46:22.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bf747462-9ca8-4d13-bda1-79bbdb2d2bea response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16112025-08-12T22:46:23.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e74e9c48-1d47-40f7-93de-f7945217d856 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16122025-08-12T22:46:23.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e74e9c48-1d47-40f7-93de-f7945217d856 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16132025-08-12T22:46:23.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e74e9c48-1d47-40f7-93de-f7945217d856 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16142025-08-12T22:46:24.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = aec39854-92fe-4950-9e96-b641f4afb749 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16152025-08-12T22:46:24.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = aec39854-92fe-4950-9e96-b641f4afb749 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16162025-08-12T22:46:24.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = aec39854-92fe-4950-9e96-b641f4afb749 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16172025-08-12T22:46:25.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 73d1cebc-5739-4638-b84e-e7ce8f28f401 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16182025-08-12T22:46:25.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 73d1cebc-5739-4638-b84e-e7ce8f28f401 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16192025-08-12T22:46:25.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 73d1cebc-5739-4638-b84e-e7ce8f28f401 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16202025-08-12T22:46:26.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 38 reason = Timeout
16212025-08-12T22:46:26.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16222025-08-12T22:46:26.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16232025-08-12T22:46:26.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16242025-08-12T22:46:26.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
16252025-08-12T22:46:26.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16262025-08-12T22:46:26.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16272025-08-12T22:46:26.048ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
16282025-08-12T22:46:26.048ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.188891ms iteration = 38 status = {"chicken_switches_updated":false}
16292025-08-12T22:46:26.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8350a1ee-5662-4b70-b9d1-c86c43133cec roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16302025-08-12T22:46:26.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8350a1ee-5662-4b70-b9d1-c86c43133cec resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16312025-08-12T22:46:26.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8350a1ee-5662-4b70-b9d1-c86c43133cec response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16322025-08-12T22:46:27.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fc0a7a62-7c7d-407f-8933-87bb058f6911 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16332025-08-12T22:46:27.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fc0a7a62-7c7d-407f-8933-87bb058f6911 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16342025-08-12T22:46:27.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fc0a7a62-7c7d-407f-8933-87bb058f6911 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16352025-08-12T22:46:28.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0855663e-bcf5-4850-a8ff-93494cd01d9d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16362025-08-12T22:46:28.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0855663e-bcf5-4850-a8ff-93494cd01d9d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16372025-08-12T22:46:28.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0855663e-bcf5-4850-a8ff-93494cd01d9d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16382025-08-12T22:46:28.829ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 553 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 870c8792-6df0-49f9-b1b9-62f2e26329df response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
16392025-08-12T22:46:29.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be1dcefd-2ce4-4cc0-a610-1dcb486e34ec roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16402025-08-12T22:46:29.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be1dcefd-2ce4-4cc0-a610-1dcb486e34ec resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16412025-08-12T22:46:29.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be1dcefd-2ce4-4cc0-a610-1dcb486e34ec response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16422025-08-12T22:46:30.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = abe58261-3222-4981-87d2-993ab3cccb04 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16432025-08-12T22:46:30.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = abe58261-3222-4981-87d2-993ab3cccb04 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16442025-08-12T22:46:30.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = abe58261-3222-4981-87d2-993ab3cccb04 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16452025-08-12T22:46:31.041ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
16462025-08-12T22:46:31.041ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
16472025-08-12T22:46:31.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16482025-08-12T22:46:31.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 39 reason = Timeout
16492025-08-12T22:46:31.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16502025-08-12T22:46:31.042ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16512025-08-12T22:46:31.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16522025-08-12T22:46:31.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16532025-08-12T22:46:31.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16542025-08-12T22:46:31.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16552025-08-12T22:46:31.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16562025-08-12T22:46:31.044ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16572025-08-12T22:46:31.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16582025-08-12T22:46:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16592025-08-12T22:46:31.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16602025-08-12T22:46:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
16612025-08-12T22:46:31.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16622025-08-12T22:46:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16632025-08-12T22:46:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16642025-08-12T22:46:31.049ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
16652025-08-12T22:46:31.049ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.178931ms iteration = 39 status = {"chicken_switches_updated":false}
16662025-08-12T22:46:31.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16672025-08-12T22:46:31.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16682025-08-12T22:46:31.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16692025-08-12T22:46:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
16702025-08-12T22:46:31.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16712025-08-12T22:46:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16722025-08-12T22:46:31.072ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
16732025-08-12T22:46:31.072ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.163336ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
16742025-08-12T22:46:31.082ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.289145ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16752025-08-12T22:46:31.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 827088d7-cc87-4ee3-8695-c434fb82fdf3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16762025-08-12T22:46:31.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 827088d7-cc87-4ee3-8695-c434fb82fdf3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16772025-08-12T22:46:31.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 827088d7-cc87-4ee3-8695-c434fb82fdf3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16782025-08-12T22:46:32.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d9f612e-faff-4bbe-92bf-4344ddd323cd roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16792025-08-12T22:46:32.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d9f612e-faff-4bbe-92bf-4344ddd323cd resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16802025-08-12T22:46:32.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d9f612e-faff-4bbe-92bf-4344ddd323cd response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16812025-08-12T22:46:33.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 30756a4d-b289-419a-bd8f-2f47787cbf71 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16822025-08-12T22:46:33.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 30756a4d-b289-419a-bd8f-2f47787cbf71 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16832025-08-12T22:46:33.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 30756a4d-b289-419a-bd8f-2f47787cbf71 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16842025-08-12T22:46:34.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b3c7ff59-bb3a-489e-b9c5-171f599acf0c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16852025-08-12T22:46:34.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b3c7ff59-bb3a-489e-b9c5-171f599acf0c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16862025-08-12T22:46:34.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b3c7ff59-bb3a-489e-b9c5-171f599acf0c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16872025-08-12T22:46:35.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c5acb959-a900-4fcb-b315-4368a5709810 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16882025-08-12T22:46:35.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c5acb959-a900-4fcb-b315-4368a5709810 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16892025-08-12T22:46:35.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c5acb959-a900-4fcb-b315-4368a5709810 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
16902025-08-12T22:46:36.042ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 40 reason = Timeout
16912025-08-12T22:46:36.042ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16922025-08-12T22:46:36.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16932025-08-12T22:46:36.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16942025-08-12T22:46:36.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
16952025-08-12T22:46:36.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16962025-08-12T22:46:36.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16972025-08-12T22:46:36.049ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
16982025-08-12T22:46:36.049ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.037489ms iteration = 40 status = {"chicken_switches_updated":false}
16992025-08-12T22:46:36.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a6fcd6d0-0f41-4769-a08f-3fb312cb0507 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17002025-08-12T22:46:36.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a6fcd6d0-0f41-4769-a08f-3fb312cb0507 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17012025-08-12T22:46:36.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a6fcd6d0-0f41-4769-a08f-3fb312cb0507 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17022025-08-12T22:46:37.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3f6d70fe-1c3d-4edc-ad68-28ad0f276410 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17032025-08-12T22:46:37.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3f6d70fe-1c3d-4edc-ad68-28ad0f276410 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17042025-08-12T22:46:37.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3f6d70fe-1c3d-4edc-ad68-28ad0f276410 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17052025-08-12T22:46:38.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5b8b9f33-2fc3-40d7-9b65-46a270d060bc roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17062025-08-12T22:46:38.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5b8b9f33-2fc3-40d7-9b65-46a270d060bc resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17072025-08-12T22:46:38.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5b8b9f33-2fc3-40d7-9b65-46a270d060bc response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17082025-08-12T22:46:38.829ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 516 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 3bba5cb7-99a8-4b1a-ad9d-b236c534d242 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
17092025-08-12T22:46:39.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 07fd5795-120a-48ce-b4e0-2803fb6cd22d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17102025-08-12T22:46:39.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 07fd5795-120a-48ce-b4e0-2803fb6cd22d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17112025-08-12T22:46:39.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 07fd5795-120a-48ce-b4e0-2803fb6cd22d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17122025-08-12T22:46:40.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0d789d6f-a07b-4d7a-b84e-b94e908f6256 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17132025-08-12T22:46:40.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0d789d6f-a07b-4d7a-b84e-b94e908f6256 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17142025-08-12T22:46:40.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0d789d6f-a07b-4d7a-b84e-b94e908f6256 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17152025-08-12T22:46:41.041ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
17162025-08-12T22:46:41.041ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
17172025-08-12T22:46:41.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17182025-08-12T22:46:41.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 41 reason = Timeout
17192025-08-12T22:46:41.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17202025-08-12T22:46:41.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
17212025-08-12T22:46:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17222025-08-12T22:46:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
17232025-08-12T22:46:41.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17242025-08-12T22:46:41.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17252025-08-12T22:46:41.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17262025-08-12T22:46:41.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17272025-08-12T22:46:41.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17282025-08-12T22:46:41.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.325792ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17292025-08-12T22:46:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
17302025-08-12T22:46:41.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
17312025-08-12T22:46:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
17322025-08-12T22:46:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17332025-08-12T22:46:41.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17342025-08-12T22:46:41.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17352025-08-12T22:46:41.048ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
17362025-08-12T22:46:41.048ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.496133ms iteration = 41 status = {"chicken_switches_updated":false}
17372025-08-12T22:46:41.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17382025-08-12T22:46:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17392025-08-12T22:46:41.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17402025-08-12T22:46:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
17412025-08-12T22:46:41.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17422025-08-12T22:46:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17432025-08-12T22:46:41.066ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
17442025-08-12T22:46:41.066ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.721562ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
17452025-08-12T22:46:41.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 91da870f-3ab8-48fc-bb1c-359efed5758f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17462025-08-12T22:46:41.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 91da870f-3ab8-48fc-bb1c-359efed5758f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17472025-08-12T22:46:41.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 91da870f-3ab8-48fc-bb1c-359efed5758f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17482025-08-12T22:46:42.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b71ae22d-9efe-41d3-9693-a56520b9453f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17492025-08-12T22:46:42.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b71ae22d-9efe-41d3-9693-a56520b9453f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17502025-08-12T22:46:42.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b71ae22d-9efe-41d3-9693-a56520b9453f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17512025-08-12T22:46:43.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 021ef5fc-a6ea-4e84-b79b-0a9b6256b348 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17522025-08-12T22:46:43.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 021ef5fc-a6ea-4e84-b79b-0a9b6256b348 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17532025-08-12T22:46:43.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 021ef5fc-a6ea-4e84-b79b-0a9b6256b348 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17542025-08-12T22:46:44.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5c4c2063-f086-41f6-a483-8e721fd3314a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17552025-08-12T22:46:44.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5c4c2063-f086-41f6-a483-8e721fd3314a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17562025-08-12T22:46:44.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5c4c2063-f086-41f6-a483-8e721fd3314a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17572025-08-12T22:46:45.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 39ab0d68-fc33-4ee3-8f03-5969a299d70b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17582025-08-12T22:46:45.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 39ab0d68-fc33-4ee3-8f03-5969a299d70b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17592025-08-12T22:46:45.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 39ab0d68-fc33-4ee3-8f03-5969a299d70b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17602025-08-12T22:46:46.041ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 42 reason = Timeout
17612025-08-12T22:46:46.041ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
17622025-08-12T22:46:46.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
17632025-08-12T22:46:46.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17642025-08-12T22:46:46.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
17652025-08-12T22:46:46.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
17662025-08-12T22:46:46.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
17672025-08-12T22:46:46.048ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
17682025-08-12T22:46:46.048ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.030569ms iteration = 42 status = {"chicken_switches_updated":false}
17692025-08-12T22:46:46.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0cd4c58f-7017-45a9-8ecd-01e097636b36 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17702025-08-12T22:46:46.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0cd4c58f-7017-45a9-8ecd-01e097636b36 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17712025-08-12T22:46:46.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0cd4c58f-7017-45a9-8ecd-01e097636b36 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17722025-08-12T22:46:47.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c458387b-0684-446f-b500-c0a407436b3b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17732025-08-12T22:46:47.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c458387b-0684-446f-b500-c0a407436b3b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17742025-08-12T22:46:47.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c458387b-0684-446f-b500-c0a407436b3b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17752025-08-12T22:46:48.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d5e3a283-b0ed-49b6-86a3-69b21d089a87 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17762025-08-12T22:46:48.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d5e3a283-b0ed-49b6-86a3-69b21d089a87 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17772025-08-12T22:46:48.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d5e3a283-b0ed-49b6-86a3-69b21d089a87 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17782025-08-12T22:46:48.829ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 582 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 3385d905-ef1e-4c56-9722-21bfed0a5c6f response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
17792025-08-12T22:46:49.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 37a2f808-2ea9-4c16-adee-62036071df0c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17802025-08-12T22:46:49.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 37a2f808-2ea9-4c16-adee-62036071df0c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17812025-08-12T22:46:49.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 37a2f808-2ea9-4c16-adee-62036071df0c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17822025-08-12T22:46:50.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 46b3f2a9-b8b2-4d4a-9a70-621d224611dd roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17832025-08-12T22:46:50.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 46b3f2a9-b8b2-4d4a-9a70-621d224611dd resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17842025-08-12T22:46:50.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 46b3f2a9-b8b2-4d4a-9a70-621d224611dd response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
17852025-08-12T22:46:51.040ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
17862025-08-12T22:46:51.040ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
17872025-08-12T22:46:51.040ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17882025-08-12T22:46:51.041ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
17892025-08-12T22:46:51.041ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17902025-08-12T22:46:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17912025-08-12T22:46:51.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17922025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 8 reason = Timeout
17932025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 8 reason = Timeout
17942025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 13.67\u{b5}s iteration = 8 status = {"disabled":true,"errors":[],"sps":[]}
17952025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
17962025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
17972025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17982025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17992025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
18002025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18012025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18022025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
18032025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18042025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
18052025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 43 reason = Timeout
18062025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18072025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
18082025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
18092025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18102025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
18112025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18122025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
18132025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18142025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
18152025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18162025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
18172025-08-12T22:46:51.042ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18182025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18192025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
18202025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18212025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
18222025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18232025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
18242025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18252025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 8 reason = Timeout
18262025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
18272025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
18282025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18292025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18302025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18312025-08-12T22:46:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18322025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18332025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18342025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18352025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18362025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
18372025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18382025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18392025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18402025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18412025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18422025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18432025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18442025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18452025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18462025-08-12T22:46:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
18472025-08-12T22:46:51.043ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1213, tv_nsec: 283815714 } })
18482025-08-12T22:46:51.043ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1213, tv_nsec: 283843494 } })
18492025-08-12T22:46:51.044ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
18502025-08-12T22:46:51.044ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
18512025-08-12T22:46:51.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18522025-08-12T22:46:51.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18532025-08-12T22:46:51.045ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18542025-08-12T22:46:51.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18552025-08-12T22:46:51.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.585535ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
18562025-08-12T22:46:51.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18572025-08-12T22:46:51.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18582025-08-12T22:46:51.045ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18592025-08-12T22:46:51.046ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.10012ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18602025-08-12T22:46:51.047ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18612025-08-12T22:46:51.047ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18622025-08-12T22:46:51.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18632025-08-12T22:46:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18642025-08-12T22:46:51.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18652025-08-12T22:46:51.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18662025-08-12T22:46:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18672025-08-12T22:46:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18682025-08-12T22:46:51.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18692025-08-12T22:46:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
18702025-08-12T22:46:51.050ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18712025-08-12T22:46:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18722025-08-12T22:46:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18732025-08-12T22:46:51.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18742025-08-12T22:46:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18752025-08-12T22:46:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18762025-08-12T22:46:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
18772025-08-12T22:46:51.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
18782025-08-12T22:46:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18792025-08-12T22:46:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18802025-08-12T22:46:51.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18812025-08-12T22:46:51.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18822025-08-12T22:46:51.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18832025-08-12T22:46:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
18842025-08-12T22:46:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18852025-08-12T22:46:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18862025-08-12T22:46:51.051ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18872025-08-12T22:46:51.052ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18882025-08-12T22:46:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18892025-08-12T22:46:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18902025-08-12T22:46:51.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18912025-08-12T22:46:51.053ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18922025-08-12T22:46:51.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18932025-08-12T22:46:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18942025-08-12T22:46:51.054ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18952025-08-12T22:46:51.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18962025-08-12T22:46:51.054ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1213, tv_nsec: 294391118 } })
18972025-08-12T22:46:51.054ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.631364ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18982025-08-12T22:46:51.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18992025-08-12T22:46:51.054ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
19002025-08-12T22:46:51.054ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
19012025-08-12T22:46:51.054ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 12.064768ms iteration = 43 status = {"chicken_switches_updated":false}
19022025-08-12T22:46:51.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19032025-08-12T22:46:51.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19042025-08-12T22:46:51.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19052025-08-12T22:46:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
19062025-08-12T22:46:51.056ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19072025-08-12T22:46:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19082025-08-12T22:46:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19092025-08-12T22:46:51.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19102025-08-12T22:46:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19112025-08-12T22:46:51.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19122025-08-12T22:46:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19132025-08-12T22:46:51.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
19142025-08-12T22:46:51.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19152025-08-12T22:46:51.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19162025-08-12T22:46:51.065ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
19172025-08-12T22:46:51.065ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 22.560131ms iteration = 8 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
19182025-08-12T22:46:51.085ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
19192025-08-12T22:46:51.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.91171ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
19202025-08-12T22:46:51.094ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19212025-08-12T22:46:51.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19222025-08-12T22:46:51.096ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19232025-08-12T22:46:51.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19242025-08-12T22:46:51.098ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.154771ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
19252025-08-12T22:46:51.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.278201ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19262025-08-12T22:46:51.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19272025-08-12T22:46:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19282025-08-12T22:46:51.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19292025-08-12T22:46:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19302025-08-12T22:46:51.108ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 66.012968ms iteration = 8 status = {"errors":[],"requests_created_ok":[]}
19312025-08-12T22:46:51.108ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19322025-08-12T22:46:51.108ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19332025-08-12T22:46:51.108ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19342025-08-12T22:46:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19352025-08-12T22:46:51.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19362025-08-12T22:46:51.110ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19372025-08-12T22:46:51.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19382025-08-12T22:46:51.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
19392025-08-12T22:46:51.112ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19402025-08-12T22:46:51.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19412025-08-12T22:46:51.112ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.305329ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19422025-08-12T22:46:51.113ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19432025-08-12T22:46:51.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19442025-08-12T22:46:51.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19452025-08-12T22:46:51.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19462025-08-12T22:46:51.116ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 74.133397ms iteration = 8 status = 0
19472025-08-12T22:46:51.126ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19482025-08-12T22:46:51.126ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.258537ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19492025-08-12T22:46:51.144ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
19502025-08-12T22:46:51.144ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19512025-08-12T22:46:51.144ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f992e32-369f-4a5b-97be-286a816028f7", "content-length": "26", "date": "Tue, 12 Aug 2025 22:46:51 GMT"} })
19522025-08-12T22:46:51.144ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19532025-08-12T22:46:51.144ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19542025-08-12T22:46:51.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19552025-08-12T22:46:51.145ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19562025-08-12T22:46:51.147ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 104.595886ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
19572025-08-12T22:46:51.148ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
19582025-08-12T22:46:51.148ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19592025-08-12T22:46:51.148ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d345eb1-febb-41e5-a3d2-269b8e3dd3a6", "content-length": "26", "date": "Tue, 12 Aug 2025 22:46:51 GMT"} })
19602025-08-12T22:46:51.148ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19612025-08-12T22:46:51.149ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
19622025-08-12T22:46:51.149ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19632025-08-12T22:46:51.149ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19642025-08-12T22:46:51.149ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9670c3c1-b49a-4c51-9e8a-77f5a0028edc", "content-length": "26", "date": "Tue, 12 Aug 2025 22:46:51 GMT"} })
19652025-08-12T22:46:51.149ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19662025-08-12T22:46:51.151ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
19672025-08-12T22:46:51.156ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19682025-08-12T22:46:51.156ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19692025-08-12T22:46:51.156ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.22728ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19702025-08-12T22:46:51.191ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 148.315535ms iteration = 10 status = {"physical_disks_added":0}
19712025-08-12T22:46:51.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19722025-08-12T22:46:51.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19732025-08-12T22:46:51.251ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 210.03473ms iteration = 8 status = {}
19742025-08-12T22:46:51.252ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19752025-08-12T22:46:51.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19762025-08-12T22:46:51.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19772025-08-12T22:46:51.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19782025-08-12T22:46:51.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19792025-08-12T22:46:51.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19802025-08-12T22:46:51.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19812025-08-12T22:46:51.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19822025-08-12T22:46:51.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19832025-08-12T22:46:51.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19842025-08-12T22:46:51.261ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19852025-08-12T22:46:51.261ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19862025-08-12T22:46:51.262ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "866e3110-b8a4-4460-a4bf-fe3602b08fae", "content-length": "372", "date": "Tue, 12 Aug 2025 22:46:51 GMT"} })
19872025-08-12T22:46:51.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19882025-08-12T22:46:51.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19892025-08-12T22:46:51.264ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19902025-08-12T22:46:51.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19912025-08-12T22:46:51.266ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 225.925136ms iteration = 8 status = null
19922025-08-12T22:46:51.277ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
19932025-08-12T22:46:51.277ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19942025-08-12T22:46:51.277ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7e290706-e15c-44d8-89d4-3a76866622b5", "date": "Tue, 12 Aug 2025 22:46:51 GMT"} })
19952025-08-12T22:46:51.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19962025-08-12T22:46:51.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19972025-08-12T22:46:51.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19982025-08-12T22:46:51.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19992025-08-12T22:46:51.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20002025-08-12T22:46:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20012025-08-12T22:46:51.285ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20022025-08-12T22:46:51.285ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20032025-08-12T22:46:51.286ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c126ddf2-7ad2-4af5-a6f5-203327cca307", "date": "Tue, 12 Aug 2025 22:46:51 GMT"} })
20042025-08-12T22:46:51.288ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 246.098343ms iteration = 8 status = {}
20052025-08-12T22:46:51.301ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20062025-08-12T22:46:51.301ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "abb15b3c-6d11-4ba3-b4a7-20afe3f44793", "content-length": "691", "date": "Tue, 12 Aug 2025 22:46:51 GMT"} })
20072025-08-12T22:46:51.301ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
20082025-08-12T22:46:51.301ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
20092025-08-12T22:46:51.301ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
20102025-08-12T22:46:51.303ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 261.311683ms iteration = 8 status = {}
20112025-08-12T22:46:51.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20122025-08-12T22:46:51.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20132025-08-12T22:46:51.333ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
20142025-08-12T22:46:51.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20152025-08-12T22:46:51.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20162025-08-12T22:46:51.346ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
20172025-08-12T22:46:51.346ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
20182025-08-12T22:46:51.346ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20192025-08-12T22:46:51.346ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20202025-08-12T22:46:51.346ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20212025-08-12T22:46:51.346ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20222025-08-12T22:46:51.346ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20232025-08-12T22:46:51.346ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20242025-08-12T22:46:51.346ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20252025-08-12T22:46:51.346ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20262025-08-12T22:46:51.347ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
20272025-08-12T22:46:51.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20282025-08-12T22:46:51.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20292025-08-12T22:46:51.350ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
20302025-08-12T22:46:51.350ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20312025-08-12T22:46:51.483ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e94e245c-bc74-415a-a7c0-d30929707b06", "date": "Tue, 12 Aug 2025 22:46:51 GMT"} })
20322025-08-12T22:46:51.484ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
20332025-08-12T22:46:51.484ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20342025-08-12T22:46:51.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c307b8f-36d8-4e75-8487-1283d06c3d93", "content-length": "682", "date": "Tue, 12 Aug 2025 22:46:51 GMT"} })
20352025-08-12T22:46:51.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20362025-08-12T22:46:51.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20372025-08-12T22:46:51.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20382025-08-12T22:46:51.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20392025-08-12T22:46:51.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20402025-08-12T22:46:51.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20412025-08-12T22:46:51.586ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20422025-08-12T22:46:51.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20432025-08-12T22:46:51.593ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 550.959904ms iteration = 8 status = {}
20442025-08-12T22:46:51.662ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 1
20452025-08-12T22:46:51.662ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221
20462025-08-12T22:46:51.693ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
20472025-08-12T22:46:51.693ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:57966
20482025-08-12T22:46:51.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57966 req_id = 684faf06-b877-4d72-a6cd-c5e82f55acdb roles = RoleSet { roles: {} } uri = /metrics/producers
20492025-08-12T22:46:51.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57966 req_id = 684faf06-b877-4d72-a6cd-c5e82f55acdb resource = Database result = Ok(()) uri = /metrics/producers
20502025-08-12T22:46:51.738ZINFOnexus: assigned collector to new producer collector_id = 4c467f25-cb67-42ad-b276-c490b467a350 file = nexus/src/app/oximeter.rs:76 producer_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
20512025-08-12T22:46:51.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 44669 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57966 req_id = 684faf06-b877-4d72-a6cd-c5e82f55acdb response_code = 201 uri = /metrics/producers
20522025-08-12T22:46:51.738ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "684faf06-b877-4d72-a6cd-c5e82f55acdb", "content-length": "41", "date": "Tue, 12 Aug 2025 22:46:51 GMT"} })
20532025-08-12T22:46:51.739ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
20542025-08-12T22:46:51.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4566ed8a-0c5b-466f-a5dc-04a0429c8ea8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20552025-08-12T22:46:51.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4566ed8a-0c5b-466f-a5dc-04a0429c8ea8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20562025-08-12T22:46:51.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4566ed8a-0c5b-466f-a5dc-04a0429c8ea8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20572025-08-12T22:46:52.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ae0c55c6-57b2-4dcf-8a8d-fa5712a06e6d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20582025-08-12T22:46:52.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ae0c55c6-57b2-4dcf-8a8d-fa5712a06e6d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20592025-08-12T22:46:52.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ae0c55c6-57b2-4dcf-8a8d-fa5712a06e6d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20602025-08-12T22:46:53.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 87598c8b-ebb1-4172-9cfa-30763c28042b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20612025-08-12T22:46:53.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 87598c8b-ebb1-4172-9cfa-30763c28042b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20622025-08-12T22:46:53.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 87598c8b-ebb1-4172-9cfa-30763c28042b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20632025-08-12T22:46:54.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6cea2812-0fbb-4410-9da7-b6d28bc58461 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20642025-08-12T22:46:54.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6cea2812-0fbb-4410-9da7-b6d28bc58461 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20652025-08-12T22:46:54.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6cea2812-0fbb-4410-9da7-b6d28bc58461 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20662025-08-12T22:46:55.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a5fa7adc-a9f7-4f3b-9380-ba5462005e47 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20672025-08-12T22:46:55.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a5fa7adc-a9f7-4f3b-9380-ba5462005e47 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20682025-08-12T22:46:55.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a5fa7adc-a9f7-4f3b-9380-ba5462005e47 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20692025-08-12T22:46:56.042ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 44 reason = Timeout
20702025-08-12T22:46:56.042ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
20712025-08-12T22:46:56.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
20722025-08-12T22:46:56.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20732025-08-12T22:46:56.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
20742025-08-12T22:46:56.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
20752025-08-12T22:46:56.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
20762025-08-12T22:46:56.048ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
20772025-08-12T22:46:56.048ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.782326ms iteration = 44 status = {"chicken_switches_updated":false}
20782025-08-12T22:46:56.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f41473cc-c916-4ccf-aa55-bdc93026e393 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20792025-08-12T22:46:56.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f41473cc-c916-4ccf-aa55-bdc93026e393 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20802025-08-12T22:46:56.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f41473cc-c916-4ccf-aa55-bdc93026e393 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20812025-08-12T22:46:57.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e43f3be3-a698-4f38-a13f-eb316929795b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20822025-08-12T22:46:57.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e43f3be3-a698-4f38-a13f-eb316929795b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20832025-08-12T22:46:57.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e43f3be3-a698-4f38-a13f-eb316929795b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20842025-08-12T22:46:58.830ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 887 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = a8577294-ce84-4d51-9ce0-cd64a6fd2910 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
20852025-08-12T22:46:58.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e82045de-317b-4520-898e-b0517c0a97c1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20862025-08-12T22:46:58.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e82045de-317b-4520-898e-b0517c0a97c1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20872025-08-12T22:46:58.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e82045de-317b-4520-898e-b0517c0a97c1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20882025-08-12T22:46:59.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0bd0991d-cfb6-4957-bdf2-d0de2b111aab roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20892025-08-12T22:46:59.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0bd0991d-cfb6-4957-bdf2-d0de2b111aab resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20902025-08-12T22:46:59.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 6083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0bd0991d-cfb6-4957-bdf2-d0de2b111aab response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20912025-08-12T22:47:00.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 564d5f9e-04a9-4520-bbe8-e45d8377a743 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20922025-08-12T22:47:00.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 564d5f9e-04a9-4520-bbe8-e45d8377a743 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20932025-08-12T22:47:00.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 564d5f9e-04a9-4520-bbe8-e45d8377a743 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
20942025-08-12T22:47:01.042ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
20952025-08-12T22:47:01.042ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
20962025-08-12T22:47:01.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20972025-08-12T22:47:01.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20982025-08-12T22:47:01.042ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 45 reason = Timeout
20992025-08-12T22:47:01.042ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21002025-08-12T22:47:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21012025-08-12T22:47:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21022025-08-12T22:47:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21032025-08-12T22:47:01.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21042025-08-12T22:47:01.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21052025-08-12T22:47:01.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21062025-08-12T22:47:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21072025-08-12T22:47:01.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.903568ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21082025-08-12T22:47:01.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21092025-08-12T22:47:01.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21102025-08-12T22:47:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
21112025-08-12T22:47:01.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21122025-08-12T22:47:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21132025-08-12T22:47:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21142025-08-12T22:47:01.049ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
21152025-08-12T22:47:01.049ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.604275ms iteration = 45 status = {"chicken_switches_updated":false}
21162025-08-12T22:47:01.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21172025-08-12T22:47:01.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21182025-08-12T22:47:01.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21192025-08-12T22:47:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
21202025-08-12T22:47:01.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21212025-08-12T22:47:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21222025-08-12T22:47:01.068ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
21232025-08-12T22:47:01.068ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.400009ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
21242025-08-12T22:47:01.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6b8cf820-9b0d-4539-a876-9a9e1cac01b7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21252025-08-12T22:47:01.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6b8cf820-9b0d-4539-a876-9a9e1cac01b7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21262025-08-12T22:47:01.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6b8cf820-9b0d-4539-a876-9a9e1cac01b7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21272025-08-12T22:47:03.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4bf6a151-f77c-4456-94af-31a7f15ddeb8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21282025-08-12T22:47:03.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4bf6a151-f77c-4456-94af-31a7f15ddeb8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21292025-08-12T22:47:03.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4bf6a151-f77c-4456-94af-31a7f15ddeb8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21302025-08-12T22:47:04.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b3150f7f-88f3-402b-83de-46fb9b221257 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21312025-08-12T22:47:04.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b3150f7f-88f3-402b-83de-46fb9b221257 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21322025-08-12T22:47:04.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b3150f7f-88f3-402b-83de-46fb9b221257 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21332025-08-12T22:47:05.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 81a57b76-ac12-4fff-b225-bf3cd6009e46 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21342025-08-12T22:47:05.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 81a57b76-ac12-4fff-b225-bf3cd6009e46 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21352025-08-12T22:47:05.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 81a57b76-ac12-4fff-b225-bf3cd6009e46 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21362025-08-12T22:47:06.042ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 46 reason = Timeout
21372025-08-12T22:47:06.042ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21382025-08-12T22:47:06.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21392025-08-12T22:47:06.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21402025-08-12T22:47:06.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
21412025-08-12T22:47:06.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21422025-08-12T22:47:06.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21432025-08-12T22:47:06.049ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
21442025-08-12T22:47:06.049ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.938448ms iteration = 46 status = {"chicken_switches_updated":false}
21452025-08-12T22:47:06.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6ea82fa0-2aa3-407d-91cf-234cd10ece12 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21462025-08-12T22:47:06.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6ea82fa0-2aa3-407d-91cf-234cd10ece12 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21472025-08-12T22:47:06.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6ea82fa0-2aa3-407d-91cf-234cd10ece12 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21482025-08-12T22:47:07.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 95bc33ae-ad65-4b5d-aa55-b978c88086c1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21492025-08-12T22:47:07.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 95bc33ae-ad65-4b5d-aa55-b978c88086c1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21502025-08-12T22:47:07.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 95bc33ae-ad65-4b5d-aa55-b978c88086c1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21512025-08-12T22:47:08.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0c5b8669-536f-4ac7-8108-edaa26810c10 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21522025-08-12T22:47:08.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0c5b8669-536f-4ac7-8108-edaa26810c10 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21532025-08-12T22:47:08.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0c5b8669-536f-4ac7-8108-edaa26810c10 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21542025-08-12T22:47:08.830ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 858 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 83390c08-edfa-484b-a93d-4b4c0517c030 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
21552025-08-12T22:47:09.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 61f9af95-dc4c-4f02-9302-21538c56f01a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21562025-08-12T22:47:09.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 61f9af95-dc4c-4f02-9302-21538c56f01a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21572025-08-12T22:47:09.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 61f9af95-dc4c-4f02-9302-21538c56f01a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21582025-08-12T22:47:10.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f5c413bd-896a-4430-85b9-5d6c7870c576 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21592025-08-12T22:47:10.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f5c413bd-896a-4430-85b9-5d6c7870c576 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21602025-08-12T22:47:10.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f5c413bd-896a-4430-85b9-5d6c7870c576 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21612025-08-12T22:47:11.041ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
21622025-08-12T22:47:11.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21632025-08-12T22:47:11.041ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
21642025-08-12T22:47:11.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21652025-08-12T22:47:11.042ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 47 reason = Timeout
21662025-08-12T22:47:11.042ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21672025-08-12T22:47:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21682025-08-12T22:47:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21692025-08-12T22:47:11.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21702025-08-12T22:47:11.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21712025-08-12T22:47:11.044ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21722025-08-12T22:47:11.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21732025-08-12T22:47:11.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21742025-08-12T22:47:11.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.415394ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21752025-08-12T22:47:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
21762025-08-12T22:47:11.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21772025-08-12T22:47:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21782025-08-12T22:47:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21792025-08-12T22:47:11.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21802025-08-12T22:47:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21812025-08-12T22:47:11.048ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
21822025-08-12T22:47:11.048ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.953568ms iteration = 47 status = {"chicken_switches_updated":false}
21832025-08-12T22:47:11.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21842025-08-12T22:47:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21852025-08-12T22:47:11.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21862025-08-12T22:47:11.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
21872025-08-12T22:47:11.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21882025-08-12T22:47:11.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21892025-08-12T22:47:11.069ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
21902025-08-12T22:47:11.069ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.58005ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
21912025-08-12T22:47:11.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1fcbed89-ca33-4508-bee9-7a8f9bc57dff roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21922025-08-12T22:47:11.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1fcbed89-ca33-4508-bee9-7a8f9bc57dff resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21932025-08-12T22:47:11.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1fcbed89-ca33-4508-bee9-7a8f9bc57dff response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21942025-08-12T22:47:12.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 836ae2ba-34f6-4835-8c24-9c26c182caed roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21952025-08-12T22:47:12.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 836ae2ba-34f6-4835-8c24-9c26c182caed resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21962025-08-12T22:47:12.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 836ae2ba-34f6-4835-8c24-9c26c182caed response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21972025-08-12T22:47:13.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 108f896f-20f9-44bf-8923-853cc6465cfe roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21982025-08-12T22:47:13.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 108f896f-20f9-44bf-8923-853cc6465cfe resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
21992025-08-12T22:47:13.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 108f896f-20f9-44bf-8923-853cc6465cfe response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22002025-08-12T22:47:13.817ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:53275
22012025-08-12T22:47:13.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = 18205e4e-f86d-4b77-a6da-4410818281b8 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
22022025-08-12T22:47:13.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = 18205e4e-f86d-4b77-a6da-4410818281b8 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
22032025-08-12T22:47:13.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = 18205e4e-f86d-4b77-a6da-4410818281b8 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
22042025-08-12T22:47:13.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = bd3dc2f5-b7a2-4929-a54e-89d21d373754 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
22052025-08-12T22:47:13.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = bd3dc2f5-b7a2-4929-a54e-89d21d373754 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
22062025-08-12T22:47:13.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = bd3dc2f5-b7a2-4929-a54e-89d21d373754 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
22072025-08-12T22:47:14.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 82892f0b-45b6-4d6d-b927-f982694c53af roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22082025-08-12T22:47:14.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 82892f0b-45b6-4d6d-b927-f982694c53af resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22092025-08-12T22:47:14.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 82892f0b-45b6-4d6d-b927-f982694c53af response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22102025-08-12T22:47:15.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c7a2ae6f-db3c-402c-a5d3-517a62514685 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22112025-08-12T22:47:15.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c7a2ae6f-db3c-402c-a5d3-517a62514685 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22122025-08-12T22:47:15.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c7a2ae6f-db3c-402c-a5d3-517a62514685 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22132025-08-12T22:47:16.042ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 48 reason = Timeout
22142025-08-12T22:47:16.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
22152025-08-12T22:47:16.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
22162025-08-12T22:47:16.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22172025-08-12T22:47:16.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
22182025-08-12T22:47:16.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
22192025-08-12T22:47:16.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
22202025-08-12T22:47:16.050ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
22212025-08-12T22:47:16.050ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.234861ms iteration = 48 status = {"chicken_switches_updated":false}
22222025-08-12T22:47:16.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f83013f8-f81f-4610-9904-b869aad644e5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22232025-08-12T22:47:16.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f83013f8-f81f-4610-9904-b869aad644e5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22242025-08-12T22:47:16.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f83013f8-f81f-4610-9904-b869aad644e5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22252025-08-12T22:47:17.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3406e016-4e90-4a8c-88a3-63a13bb464e3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22262025-08-12T22:47:17.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3406e016-4e90-4a8c-88a3-63a13bb464e3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22272025-08-12T22:47:17.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3406e016-4e90-4a8c-88a3-63a13bb464e3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22282025-08-12T22:47:18.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2e129a3c-67f4-4d2e-8271-d41a2ca0a0d4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22292025-08-12T22:47:18.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2e129a3c-67f4-4d2e-8271-d41a2ca0a0d4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22302025-08-12T22:47:18.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2e129a3c-67f4-4d2e-8271-d41a2ca0a0d4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22312025-08-12T22:47:18.830ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 474 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 42e25809-3a65-4db7-a00b-6ec9ab79a0a8 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
22322025-08-12T22:47:19.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ba8c29b1-1615-4e69-85c0-c7d43bd8b831 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22332025-08-12T22:47:19.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ba8c29b1-1615-4e69-85c0-c7d43bd8b831 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22342025-08-12T22:47:19.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ba8c29b1-1615-4e69-85c0-c7d43bd8b831 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22352025-08-12T22:47:20.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a007686c-75fc-4342-a1bf-75392598b90e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22362025-08-12T22:47:20.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a007686c-75fc-4342-a1bf-75392598b90e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22372025-08-12T22:47:20.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a007686c-75fc-4342-a1bf-75392598b90e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
22382025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
22392025-08-12T22:47:21.041ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0
22402025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.02\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0"}
22412025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
22422025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
22432025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22442025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22452025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22462025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
22472025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
22482025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
22492025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22502025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
22512025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
22522025-08-12T22:47:21.041ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-12 22:37:21.041391754 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22532025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22542025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
22552025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
22562025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
22572025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22582025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22592025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
22602025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22612025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22622025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22632025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
22642025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22652025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22662025-08-12T22:47:21.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22672025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 8 reason = Timeout
22682025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
22692025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 9.169\u{b5}s iteration = 8 status = "Disabled"
22702025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
22712025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22722025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 9 reason = Timeout
22732025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
22742025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
22752025-08-12T22:47:21.042ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22762025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22772025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
22782025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22792025-08-12T22:47:21.042ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3e3264d-303d-4ce7-a0ce-0090b10b154f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1243, tv_nsec: 281667440 } })
22802025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
22812025-08-12T22:47:21.042ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("043b8097-0e38-4228-bada-dac70e518148.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26cd5275-57f5-4466-a94f-f96956f55588.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1243, tv_nsec: 281669090 } })
22822025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22832025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
22842025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22852025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
22862025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22872025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22882025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
22892025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22902025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
22912025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22922025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 49 reason = Timeout
22932025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
22942025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
22952025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
22962025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22972025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22982025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 5 reason = Timeout
22992025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
23002025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23012025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
23022025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
23032025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
23042025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
23052025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23062025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 9 reason = Timeout
23072025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
23082025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 9 reason = Timeout
23092025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23102025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
23112025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23122025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23132025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 10.13\u{b5}s iteration = 9 status = {"disabled":true,"errors":[],"sps":[]}
23142025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
23152025-08-12T22:47:21.042ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
23162025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 5 reason = Timeout
23172025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23182025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
23192025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
23202025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23212025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
23222025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23232025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23242025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
23252025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23262025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23272025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23282025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23292025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23302025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23312025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23322025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
23332025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.376143ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
23342025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23352025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
23362025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
23372025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
23382025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23392025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.414734ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
23402025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
23412025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23422025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23432025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23442025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23452025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23462025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23472025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
23482025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23492025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23502025-08-12T22:47:21.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23512025-08-12T22:47:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23522025-08-12T22:47:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23532025-08-12T22:47:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23542025-08-12T22:47:21.043ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23552025-08-12T22:47:21.044ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-12 22:37:21.041391754 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23562025-08-12T22:47:21.044ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.924718ms iteration = 5 status = {"expiration":"2025-08-12T22:37:21.041391754Z","pruned":[]}
23572025-08-12T22:47:21.044ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23582025-08-12T22:47:21.044ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1243, tv_nsec: 284117254 } })
23592025-08-12T22:47:21.044ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1243, tv_nsec: 284250095 } })
23602025-08-12T22:47:21.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.444344ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
23612025-08-12T22:47:21.044ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
23622025-08-12T22:47:21.044ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23632025-08-12T22:47:21.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23642025-08-12T22:47:21.045ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
23652025-08-12T22:47:21.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23662025-08-12T22:47:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.996169ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23672025-08-12T22:47:21.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23682025-08-12T22:47:21.046ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
23692025-08-12T22:47:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 4.397932ms iteration = 5 status = {"by_rx":{},"error":null}
23702025-08-12T22:47:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.582504ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
23712025-08-12T22:47:21.046ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23722025-08-12T22:47:21.046ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23732025-08-12T22:47:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23742025-08-12T22:47:21.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23752025-08-12T22:47:21.047ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 5.536184ms iteration = 9 status = {"errors":[],"requests_created_ok":[]}
23762025-08-12T22:47:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23772025-08-12T22:47:21.047ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23782025-08-12T22:47:21.047ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23792025-08-12T22:47:21.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23802025-08-12T22:47:21.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23812025-08-12T22:47:21.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23822025-08-12T22:47:21.048ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23832025-08-12T22:47:21.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23842025-08-12T22:47:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23852025-08-12T22:47:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23862025-08-12T22:47:21.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23872025-08-12T22:47:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.019969ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
23882025-08-12T22:47:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
23892025-08-12T22:47:21.048ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23902025-08-12T22:47:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23912025-08-12T22:47:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23922025-08-12T22:47:21.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23932025-08-12T22:47:21.049ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23942025-08-12T22:47:21.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23952025-08-12T22:47:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23962025-08-12T22:47:21.050ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
23972025-08-12T22:47:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
23982025-08-12T22:47:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23992025-08-12T22:47:21.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24002025-08-12T22:47:21.050ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24012025-08-12T22:47:21.050ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24022025-08-12T22:47:21.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24032025-08-12T22:47:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 9.033468ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24042025-08-12T22:47:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24052025-08-12T22:47:21.051ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24062025-08-12T22:47:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24072025-08-12T22:47:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24082025-08-12T22:47:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24092025-08-12T22:47:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.730726ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24102025-08-12T22:47:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
24112025-08-12T22:47:21.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
24122025-08-12T22:47:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24132025-08-12T22:47:21.053ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24142025-08-12T22:47:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
24152025-08-12T22:47:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24162025-08-12T22:47:21.053ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24172025-08-12T22:47:21.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24182025-08-12T22:47:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24192025-08-12T22:47:21.054ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 11.701155ms iteration = 5 status = {"dispatched":[],"errors":[],"glob_version":"180.0.0","globs_reprocessed":{},"no_receivers":[]}
24202025-08-12T22:47:21.054ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24212025-08-12T22:47:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24222025-08-12T22:47:21.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24232025-08-12T22:47:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24242025-08-12T22:47:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24252025-08-12T22:47:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24262025-08-12T22:47:21.054ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24272025-08-12T22:47:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24282025-08-12T22:47:21.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
24292025-08-12T22:47:21.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 12.980217ms iteration = 49 status = {"chicken_switches_updated":false}
24302025-08-12T22:47:21.055ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24312025-08-12T22:47:21.056ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
24322025-08-12T22:47:21.056ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
24332025-08-12T22:47:21.056ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
24342025-08-12T22:47:21.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24352025-08-12T22:47:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24362025-08-12T22:47:21.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24372025-08-12T22:47:21.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24382025-08-12T22:47:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24392025-08-12T22:47:21.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24402025-08-12T22:47:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
24412025-08-12T22:47:21.060ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24422025-08-12T22:47:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24432025-08-12T22:47:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24442025-08-12T22:47:21.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24452025-08-12T22:47:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24462025-08-12T22:47:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24472025-08-12T22:47:21.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24482025-08-12T22:47:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24492025-08-12T22:47:21.065ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24502025-08-12T22:47:21.065ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.124337ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24512025-08-12T22:47:21.065ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24522025-08-12T22:47:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24532025-08-12T22:47:21.067ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24542025-08-12T22:47:21.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24552025-08-12T22:47:21.069ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24562025-08-12T22:47:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24572025-08-12T22:47:21.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24582025-08-12T22:47:21.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24592025-08-12T22:47:21.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24602025-08-12T22:47:21.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24612025-08-12T22:47:21.101ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
24622025-08-12T22:47:21.101ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
24632025-08-12T22:47:21.101ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 59.0631ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
24642025-08-12T22:47:21.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24652025-08-12T22:47:21.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24662025-08-12T22:47:21.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24672025-08-12T22:47:21.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24682025-08-12T22:47:21.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24692025-08-12T22:47:21.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24702025-08-12T22:47:21.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24712025-08-12T22:47:21.105ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24722025-08-12T22:47:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24732025-08-12T22:47:21.106ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24742025-08-12T22:47:21.106ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24752025-08-12T22:47:21.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24762025-08-12T22:47:21.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24772025-08-12T22:47:21.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24782025-08-12T22:47:21.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24792025-08-12T22:47:21.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24802025-08-12T22:47:21.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.201609ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24812025-08-12T22:47:21.108ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24822025-08-12T22:47:21.108ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24832025-08-12T22:47:21.108ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24842025-08-12T22:47:21.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24852025-08-12T22:47:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24862025-08-12T22:47:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
24872025-08-12T22:47:21.109ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24882025-08-12T22:47:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
24892025-08-12T22:47:21.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24902025-08-12T22:47:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24912025-08-12T22:47:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24922025-08-12T22:47:21.110ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1243, tv_nsec: 349674497 } })
24932025-08-12T22:47:21.110ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
24942025-08-12T22:47:21.110ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24952025-08-12T22:47:21.110ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24962025-08-12T22:47:21.110ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24972025-08-12T22:47:21.110ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 68.825966ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24982025-08-12T22:47:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24992025-08-12T22:47:21.115ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25002025-08-12T22:47:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25012025-08-12T22:47:21.118ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
25022025-08-12T22:47:21.118ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 0 version = 2
25032025-08-12T22:47:21.118ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25042025-08-12T22:47:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25052025-08-12T22:47:21.122ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25062025-08-12T22:47:21.122ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
25072025-08-12T22:47:21.122ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.173826ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25082025-08-12T22:47:21.122ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25092025-08-12T22:47:21.123ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25102025-08-12T22:47:21.123ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
25112025-08-12T22:47:21.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25122025-08-12T22:47:21.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25132025-08-12T22:47:21.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25142025-08-12T22:47:21.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25152025-08-12T22:47:21.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25162025-08-12T22:47:21.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25172025-08-12T22:47:21.129ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 87.407717ms iteration = 11 status = {"physical_disks_added":0}
25182025-08-12T22:47:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25192025-08-12T22:47:21.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25202025-08-12T22:47:21.131ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 4 version = 2
25212025-08-12T22:47:21.131ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
25222025-08-12T22:47:21.131ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-12 22:43:50.527483 UTC dns_group = external generation = 2
25232025-08-12T22:47:21.131ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 90.176144ms iteration = 5 status = {"generation":2}
25242025-08-12T22:47:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25252025-08-12T22:47:21.133ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
25262025-08-12T22:47:21.134ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
25272025-08-12T22:47:21.134ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-12 22:43:49.909589 UTC dns_group = internal generation = 1
25282025-08-12T22:47:21.134ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 92.741729ms iteration = 5 status = {"generation":1}
25292025-08-12T22:47:21.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25302025-08-12T22:47:21.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25312025-08-12T22:47:21.138ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
25322025-08-12T22:47:21.138ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.450496ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
25332025-08-12T22:47:21.139ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25342025-08-12T22:47:21.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25352025-08-12T22:47:21.141ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25362025-08-12T22:47:21.141ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-12T22:43:09.981233Z, time_modified: 2025-08-12T22:43:09.981233Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }) }
25372025-08-12T22:47:21.141ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 100.370824ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]}},"default_endpoint":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
25382025-08-12T22:47:21.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
25392025-08-12T22:47:21.143ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25402025-08-12T22:47:21.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25412025-08-12T22:47:21.145ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.891159ms iteration = 9 status = 0
25422025-08-12T22:47:21.154ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25432025-08-12T22:47:21.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25442025-08-12T22:47:21.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.795456ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
25452025-08-12T22:47:21.156ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
25462025-08-12T22:47:21.156ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 114.060239ms iteration = 9 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
25472025-08-12T22:47:21.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25482025-08-12T22:47:21.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25492025-08-12T22:47:21.192ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
25502025-08-12T22:47:21.192ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 150.441916ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
25512025-08-12T22:47:21.195ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25522025-08-12T22:47:21.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25532025-08-12T22:47:21.196ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25542025-08-12T22:47:21.198ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25552025-08-12T22:47:21.198ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25562025-08-12T22:47:21.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25572025-08-12T22:47:21.200ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25582025-08-12T22:47:21.201ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25592025-08-12T22:47:21.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25602025-08-12T22:47:21.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25612025-08-12T22:47:21.209ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25622025-08-12T22:47:21.212ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
25632025-08-12T22:47:21.232ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25642025-08-12T22:47:21.232ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25652025-08-12T22:47:21.233ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a718807-c966-42dc-899c-45e7ea359d91", "content-length": "372", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} })
25662025-08-12T22:47:21.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25672025-08-12T22:47:21.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25682025-08-12T22:47:21.283ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
25692025-08-12T22:47:21.283ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25702025-08-12T22:47:21.283ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "213f7e2e-2673-4996-9f5e-1a57d9c62679", "content-length": "26", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} })
25712025-08-12T22:47:21.283ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25722025-08-12T22:47:21.284ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
25732025-08-12T22:47:21.286ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
25742025-08-12T22:47:21.286ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25752025-08-12T22:47:21.286ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6f4c8218-4668-4826-816d-193d5918ba65", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} })
25762025-08-12T22:47:21.286ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25772025-08-12T22:47:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25782025-08-12T22:47:21.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25792025-08-12T22:47:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25802025-08-12T22:47:21.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25812025-08-12T22:47:21.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25822025-08-12T22:47:21.299ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25832025-08-12T22:47:21.299ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25842025-08-12T22:47:21.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6037d792-1082-41eb-a387-45ea3ba9163e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
25852025-08-12T22:47:21.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6037d792-1082-41eb-a387-45ea3ba9163e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
25862025-08-12T22:47:21.299ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "beffc4e8-f925-494f-8f62-de529de5c726", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} })
25872025-08-12T22:47:21.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6037d792-1082-41eb-a387-45ea3ba9163e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
25882025-08-12T22:47:21.301ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 259.129271ms iteration = 9 status = {}
25892025-08-12T22:47:21.362ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
25902025-08-12T22:47:21.362ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25912025-08-12T22:47:21.362ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fcb778a-9fa6-4831-9015-f99f09f878d4", "content-length": "26", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} })
25922025-08-12T22:47:21.362ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25932025-08-12T22:47:21.364ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25942025-08-12T22:47:21.375ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
25952025-08-12T22:47:21.375ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25962025-08-12T22:47:21.376ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fa882a6-1dab-4d5a-b4b1-777cfe825b41", "content-length": "26", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} })
25972025-08-12T22:47:21.376ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25982025-08-12T22:47:21.377ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25992025-08-12T22:47:21.393ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26002025-08-12T22:47:21.393ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8e0b6a8-f900-4b1c-a7eb-c086513d9710", "content-length": "691", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} })
26012025-08-12T22:47:21.393ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
26022025-08-12T22:47:21.393ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
26032025-08-12T22:47:21.393ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
26042025-08-12T22:47:21.395ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 352.864261ms iteration = 9 status = {}
26052025-08-12T22:47:21.402ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26062025-08-12T22:47:21.405ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26072025-08-12T22:47:21.406ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4bdc81bb-0f9e-4847-9231-ad24315d3622", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26082025-08-12T22:47:21.406ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26092025-08-12T22:47:21.414ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a653af30-4176-4726-9f4e-081315a8c3f5", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26102025-08-12T22:47:21.414ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26112025-08-12T22:47:21.416ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26122025-08-12T22:47:21.416ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 374.829026ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26132025-08-12T22:47:21.486ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26142025-08-12T22:47:21.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26152025-08-12T22:47:21.487ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 446.173316ms iteration = 9 status = {}
26162025-08-12T22:47:21.489ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 447.686881ms iteration = 9 status = null
26172025-08-12T22:47:21.507ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26182025-08-12T22:47:21.508ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9376d829-ecd0-421f-8680-7bbdc35c5339", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26192025-08-12T22:47:21.508ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26202025-08-12T22:47:21.509ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "75ee0705-333f-4aeb-8ffa-f8ed75343ba6", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26212025-08-12T22:47:21.509ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26222025-08-12T22:47:21.511ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c9e85b26-814e-4e2e-8ab9-00fe1661e927", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26232025-08-12T22:47:21.512ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26242025-08-12T22:47:21.514ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
26252025-08-12T22:47:21.514ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 472.856018ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26262025-08-12T22:47:21.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26272025-08-12T22:47:21.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26282025-08-12T22:47:21.548ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
26292025-08-12T22:47:21.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26302025-08-12T22:47:21.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26312025-08-12T22:47:21.664ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
26322025-08-12T22:47:21.664ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
26332025-08-12T22:47:21.664ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26342025-08-12T22:47:21.664ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26352025-08-12T22:47:21.664ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26362025-08-12T22:47:21.664ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26372025-08-12T22:47:21.664ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26382025-08-12T22:47:21.664ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26392025-08-12T22:47:21.665ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26402025-08-12T22:47:21.665ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26412025-08-12T22:47:21.665ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
26422025-08-12T22:47:21.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26432025-08-12T22:47:21.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26442025-08-12T22:47:21.670ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
26452025-08-12T22:47:21.670ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26462025-08-12T22:47:21.781ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "29cc4779-f91c-47d9-b558-73a1473f0bc2", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} })
26472025-08-12T22:47:21.781ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
26482025-08-12T22:47:21.781ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26492025-08-12T22:47:21.781ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "497a3bb8-408f-4b8b-9a0a-2c9b4877566d", "content-length": "682", "date": "Tue, 12 Aug 2025 22:47:21 GMT"} })
26502025-08-12T22:47:21.781ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26512025-08-12T22:47:21.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26522025-08-12T22:47:21.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26532025-08-12T22:47:21.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26542025-08-12T22:47:21.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26552025-08-12T22:47:21.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26562025-08-12T22:47:21.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26572025-08-12T22:47:21.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26582025-08-12T22:47:21.798ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 756.392507ms iteration = 9 status = {}
26592025-08-12T22:47:22.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7ae768a0-eecb-457c-b420-95e3bc85da74 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26602025-08-12T22:47:22.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7ae768a0-eecb-457c-b420-95e3bc85da74 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26612025-08-12T22:47:22.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7ae768a0-eecb-457c-b420-95e3bc85da74 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26622025-08-12T22:47:23.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e1013d74-14b8-4229-9fe3-95df37f02c06 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26632025-08-12T22:47:23.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e1013d74-14b8-4229-9fe3-95df37f02c06 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26642025-08-12T22:47:23.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e1013d74-14b8-4229-9fe3-95df37f02c06 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26652025-08-12T22:47:24.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2d1bb054-fbf2-4e42-a3ed-6a1addea3646 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26662025-08-12T22:47:24.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2d1bb054-fbf2-4e42-a3ed-6a1addea3646 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26672025-08-12T22:47:24.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2d1bb054-fbf2-4e42-a3ed-6a1addea3646 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26682025-08-12T22:47:25.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1be2aff3-ca43-4d08-a9e0-4c140bb1b6de roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26692025-08-12T22:47:25.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1be2aff3-ca43-4d08-a9e0-4c140bb1b6de resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26702025-08-12T22:47:25.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1be2aff3-ca43-4d08-a9e0-4c140bb1b6de response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26712025-08-12T22:47:26.042ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 50 reason = Timeout
26722025-08-12T22:47:26.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
26732025-08-12T22:47:26.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
26742025-08-12T22:47:26.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26752025-08-12T22:47:26.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
26762025-08-12T22:47:26.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
26772025-08-12T22:47:26.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
26782025-08-12T22:47:26.049ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
26792025-08-12T22:47:26.049ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.597355ms iteration = 50 status = {"chicken_switches_updated":false}
26802025-08-12T22:47:26.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0dce1dcb-9365-49bb-aa86-c63b3401b121 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26812025-08-12T22:47:26.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0dce1dcb-9365-49bb-aa86-c63b3401b121 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26822025-08-12T22:47:26.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0dce1dcb-9365-49bb-aa86-c63b3401b121 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26832025-08-12T22:47:27.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8c675e2c-8cc0-4028-b476-c781b6061e7f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26842025-08-12T22:47:27.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8c675e2c-8cc0-4028-b476-c781b6061e7f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26852025-08-12T22:47:27.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8c675e2c-8cc0-4028-b476-c781b6061e7f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26862025-08-12T22:47:28.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e0610aba-bd7d-4f65-9106-416ede424e63 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26872025-08-12T22:47:28.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e0610aba-bd7d-4f65-9106-416ede424e63 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26882025-08-12T22:47:28.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e0610aba-bd7d-4f65-9106-416ede424e63 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26892025-08-12T22:47:28.830ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 886 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 97b5cc31-19bf-4a1b-96dc-ea25f5ed6bc5 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
26902025-08-12T22:47:29.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be78d336-19cd-4034-bee0-3a452c0ef7c3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26912025-08-12T22:47:29.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be78d336-19cd-4034-bee0-3a452c0ef7c3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26922025-08-12T22:47:29.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be78d336-19cd-4034-bee0-3a452c0ef7c3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26932025-08-12T22:47:30.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4549280b-ff8f-455a-a79e-6cb97d5e6ad8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26942025-08-12T22:47:30.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4549280b-ff8f-455a-a79e-6cb97d5e6ad8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26952025-08-12T22:47:30.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2682 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4549280b-ff8f-455a-a79e-6cb97d5e6ad8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
26962025-08-12T22:47:31.042ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
26972025-08-12T22:47:31.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26982025-08-12T22:47:31.042ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
26992025-08-12T22:47:31.042ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 51 reason = Timeout
27002025-08-12T22:47:31.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27012025-08-12T22:47:31.042ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
27022025-08-12T22:47:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
27032025-08-12T22:47:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27042025-08-12T22:47:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27052025-08-12T22:47:31.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27062025-08-12T22:47:31.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27072025-08-12T22:47:31.044ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27082025-08-12T22:47:31.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27092025-08-12T22:47:31.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.899119ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27102025-08-12T22:47:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
27112025-08-12T22:47:31.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
27122025-08-12T22:47:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27132025-08-12T22:47:31.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27142025-08-12T22:47:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
27152025-08-12T22:47:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27162025-08-12T22:47:31.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27172025-08-12T22:47:31.049ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
27182025-08-12T22:47:31.049ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.673955ms iteration = 51 status = {"chicken_switches_updated":false}
27192025-08-12T22:47:31.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27202025-08-12T22:47:31.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27212025-08-12T22:47:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
27222025-08-12T22:47:31.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27232025-08-12T22:47:31.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27242025-08-12T22:47:31.067ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
27252025-08-12T22:47:31.067ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.427039ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
27262025-08-12T22:47:31.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f9a27040-5681-497d-8c6d-59223c8a317e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27272025-08-12T22:47:31.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f9a27040-5681-497d-8c6d-59223c8a317e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27282025-08-12T22:47:31.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f9a27040-5681-497d-8c6d-59223c8a317e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27292025-08-12T22:47:32.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4fc3a0ab-c15a-49f1-86c8-49ac83221725 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27302025-08-12T22:47:32.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4fc3a0ab-c15a-49f1-86c8-49ac83221725 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27312025-08-12T22:47:32.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4fc3a0ab-c15a-49f1-86c8-49ac83221725 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27322025-08-12T22:47:33.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 05fcb39e-5be6-4f3b-b5cd-690eba31fee1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27332025-08-12T22:47:33.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 05fcb39e-5be6-4f3b-b5cd-690eba31fee1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27342025-08-12T22:47:33.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 05fcb39e-5be6-4f3b-b5cd-690eba31fee1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27352025-08-12T22:47:34.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 860fd52d-e584-48ec-ba37-9ef975371573 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27362025-08-12T22:47:34.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 860fd52d-e584-48ec-ba37-9ef975371573 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27372025-08-12T22:47:34.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 860fd52d-e584-48ec-ba37-9ef975371573 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27382025-08-12T22:47:35.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cfee00cd-85fc-41b6-9c42-2546894e3894 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27392025-08-12T22:47:35.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cfee00cd-85fc-41b6-9c42-2546894e3894 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27402025-08-12T22:47:35.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cfee00cd-85fc-41b6-9c42-2546894e3894 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27412025-08-12T22:47:36.042ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 52 reason = Timeout
27422025-08-12T22:47:36.042ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
27432025-08-12T22:47:36.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
27442025-08-12T22:47:36.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27452025-08-12T22:47:36.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
27462025-08-12T22:47:36.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
27472025-08-12T22:47:36.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
27482025-08-12T22:47:36.049ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
27492025-08-12T22:47:36.049ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.823147ms iteration = 52 status = {"chicken_switches_updated":false}
27502025-08-12T22:47:36.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f4f4dabe-5486-4280-a0fc-1dddcfc14160 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27512025-08-12T22:47:36.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f4f4dabe-5486-4280-a0fc-1dddcfc14160 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27522025-08-12T22:47:36.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f4f4dabe-5486-4280-a0fc-1dddcfc14160 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27532025-08-12T22:47:37.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2cb5af02-d006-4405-be43-0a34b52fd7c4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27542025-08-12T22:47:37.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2cb5af02-d006-4405-be43-0a34b52fd7c4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27552025-08-12T22:47:37.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2cb5af02-d006-4405-be43-0a34b52fd7c4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27562025-08-12T22:47:38.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 159f6714-bc6a-4780-a449-a02dcee4a176 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27572025-08-12T22:47:38.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 159f6714-bc6a-4780-a449-a02dcee4a176 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27582025-08-12T22:47:38.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 159f6714-bc6a-4780-a449-a02dcee4a176 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27592025-08-12T22:47:38.831ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 543 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 4a67c4e7-2bfc-4d7a-956e-c2b6d345fea1 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
27602025-08-12T22:47:39.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3bd89f85-53a4-4a89-82be-a0bb14d88429 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27612025-08-12T22:47:39.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3bd89f85-53a4-4a89-82be-a0bb14d88429 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27622025-08-12T22:47:39.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3bd89f85-53a4-4a89-82be-a0bb14d88429 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27632025-08-12T22:47:40.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 493fbcd5-13f0-452a-acec-4e47864f054d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27642025-08-12T22:47:40.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 493fbcd5-13f0-452a-acec-4e47864f054d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27652025-08-12T22:47:40.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 493fbcd5-13f0-452a-acec-4e47864f054d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27662025-08-12T22:47:41.042ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
27672025-08-12T22:47:41.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27682025-08-12T22:47:41.042ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
27692025-08-12T22:47:41.042ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 53 reason = Timeout
27702025-08-12T22:47:41.042ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
27712025-08-12T22:47:41.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27722025-08-12T22:47:41.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27732025-08-12T22:47:41.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27742025-08-12T22:47:41.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
27752025-08-12T22:47:41.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27762025-08-12T22:47:41.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27772025-08-12T22:47:41.044ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27782025-08-12T22:47:41.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27792025-08-12T22:47:41.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.384423ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27802025-08-12T22:47:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27812025-08-12T22:47:41.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27822025-08-12T22:47:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
27832025-08-12T22:47:41.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
27842025-08-12T22:47:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27852025-08-12T22:47:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
27862025-08-12T22:47:41.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27872025-08-12T22:47:41.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27882025-08-12T22:47:41.050ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
27892025-08-12T22:47:41.050ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.003349ms iteration = 53 status = {"chicken_switches_updated":false}
27902025-08-12T22:47:41.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27912025-08-12T22:47:41.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
27922025-08-12T22:47:41.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27932025-08-12T22:47:41.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27942025-08-12T22:47:41.066ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
27952025-08-12T22:47:41.066ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.934064ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
27962025-08-12T22:47:41.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0211827d-91d0-4f0b-9cfd-262ba178cb9a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27972025-08-12T22:47:41.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0211827d-91d0-4f0b-9cfd-262ba178cb9a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27982025-08-12T22:47:41.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0211827d-91d0-4f0b-9cfd-262ba178cb9a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
27992025-08-12T22:47:42.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c1e70d85-8f06-4d2f-8449-d39fc1b7a069 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28002025-08-12T22:47:42.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c1e70d85-8f06-4d2f-8449-d39fc1b7a069 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28012025-08-12T22:47:42.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c1e70d85-8f06-4d2f-8449-d39fc1b7a069 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28022025-08-12T22:47:43.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2ea9a600-e679-4025-ab63-8a167e176392 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28032025-08-12T22:47:43.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2ea9a600-e679-4025-ab63-8a167e176392 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28042025-08-12T22:47:43.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2ea9a600-e679-4025-ab63-8a167e176392 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28052025-08-12T22:47:43.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = e51a789c-7d47-49d7-a780-6ac6a407c335 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
28062025-08-12T22:47:43.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = e51a789c-7d47-49d7-a780-6ac6a407c335 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
28072025-08-12T22:47:43.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = e51a789c-7d47-49d7-a780-6ac6a407c335 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
28082025-08-12T22:47:43.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = 19eb858b-166b-469b-99f8-df9548a65a2f roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
28092025-08-12T22:47:43.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = 19eb858b-166b-469b-99f8-df9548a65a2f resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
28102025-08-12T22:47:43.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = 19eb858b-166b-469b-99f8-df9548a65a2f response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
28112025-08-12T22:47:44.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6867b6c3-fe14-4342-95bd-55a5d543b5fc roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28122025-08-12T22:47:44.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6867b6c3-fe14-4342-95bd-55a5d543b5fc resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28132025-08-12T22:47:44.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6867b6c3-fe14-4342-95bd-55a5d543b5fc response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28142025-08-12T22:47:45.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5816166f-0f31-4158-80d8-4cc48797ffc9 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28152025-08-12T22:47:45.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5816166f-0f31-4158-80d8-4cc48797ffc9 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28162025-08-12T22:47:45.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5816166f-0f31-4158-80d8-4cc48797ffc9 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28172025-08-12T22:47:46.043ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 54 reason = Timeout
28182025-08-12T22:47:46.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
28192025-08-12T22:47:46.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
28202025-08-12T22:47:46.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28212025-08-12T22:47:46.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
28222025-08-12T22:47:46.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
28232025-08-12T22:47:46.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
28242025-08-12T22:47:46.050ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
28252025-08-12T22:47:46.050ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.094659ms iteration = 54 status = {"chicken_switches_updated":false}
28262025-08-12T22:47:46.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e0f4f017-9ae0-4525-95cc-9366f75195db roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28272025-08-12T22:47:46.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e0f4f017-9ae0-4525-95cc-9366f75195db resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28282025-08-12T22:47:46.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e0f4f017-9ae0-4525-95cc-9366f75195db response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28292025-08-12T22:47:47.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ef25c52d-139c-45f6-b429-b217594235e3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28302025-08-12T22:47:47.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ef25c52d-139c-45f6-b429-b217594235e3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28312025-08-12T22:47:47.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ef25c52d-139c-45f6-b429-b217594235e3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28322025-08-12T22:47:48.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ff044d44-0f08-4821-aae8-64103b0058a4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28332025-08-12T22:47:48.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ff044d44-0f08-4821-aae8-64103b0058a4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28342025-08-12T22:47:48.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ff044d44-0f08-4821-aae8-64103b0058a4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28352025-08-12T22:47:48.830ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 543 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = ed8c0d34-66c7-4f74-8859-4e66e78460e8 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
28362025-08-12T22:47:49.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e9d5fd5f-01a0-4bd6-b086-dd90642cbfa1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28372025-08-12T22:47:49.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e9d5fd5f-01a0-4bd6-b086-dd90642cbfa1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28382025-08-12T22:47:49.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e9d5fd5f-01a0-4bd6-b086-dd90642cbfa1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28392025-08-12T22:47:50.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3bea4d27-5208-4ce6-a4ae-9b28d207c1fa roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28402025-08-12T22:47:50.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3bea4d27-5208-4ce6-a4ae-9b28d207c1fa resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28412025-08-12T22:47:50.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3bea4d27-5208-4ce6-a4ae-9b28d207c1fa response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
28422025-08-12T22:47:51.041ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
28432025-08-12T22:47:51.041ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
28442025-08-12T22:47:51.041ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28452025-08-12T22:47:51.041ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
28462025-08-12T22:47:51.041ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28472025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28482025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28492025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 10 reason = Timeout
28502025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
28512025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
28522025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 13.24\u{b5}s iteration = 10 status = {"disabled":true,"errors":[],"sps":[]}
28532025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
28542025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28552025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28562025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
28572025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28582025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
28592025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28602025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28612025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 55 reason = Timeout
28622025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
28632025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28642025-08-12T22:47:51.042ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
28652025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 10 reason = Timeout
28662025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
28672025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
28682025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28692025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
28702025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28712025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
28722025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
28732025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28742025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28752025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28762025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
28772025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28782025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 10 reason = Timeout
28792025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28802025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
28812025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28822025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
28832025-08-12T22:47:51.043ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28842025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28852025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
28862025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28872025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28882025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28892025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28902025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28912025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28922025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28932025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28942025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28952025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28962025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28972025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28982025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
28992025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29002025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29012025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
29022025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29032025-08-12T22:47:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29042025-08-12T22:47:51.044ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29052025-08-12T22:47:51.044ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1273, tv_nsec: 283790729 } })
29062025-08-12T22:47:51.045ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.490904ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29072025-08-12T22:47:51.045ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
29082025-08-12T22:47:51.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29092025-08-12T22:47:51.045ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1273, tv_nsec: 284356554 } })
29102025-08-12T22:47:51.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.454474ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
29112025-08-12T22:47:51.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29122025-08-12T22:47:51.045ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
29132025-08-12T22:47:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29142025-08-12T22:47:51.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.975819ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
29152025-08-12T22:47:51.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29162025-08-12T22:47:51.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29172025-08-12T22:47:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29182025-08-12T22:47:51.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29192025-08-12T22:47:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29202025-08-12T22:47:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29212025-08-12T22:47:51.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29222025-08-12T22:47:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29232025-08-12T22:47:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29242025-08-12T22:47:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29252025-08-12T22:47:51.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29262025-08-12T22:47:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29272025-08-12T22:47:51.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.556194ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29282025-08-12T22:47:51.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 7.966259ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29292025-08-12T22:47:51.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29302025-08-12T22:47:51.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29312025-08-12T22:47:51.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29322025-08-12T22:47:51.051ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29332025-08-12T22:47:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29342025-08-12T22:47:51.051ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29352025-08-12T22:47:51.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29362025-08-12T22:47:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29372025-08-12T22:47:51.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29382025-08-12T22:47:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29392025-08-12T22:47:51.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 8.768956ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29402025-08-12T22:47:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29412025-08-12T22:47:51.052ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1273, tv_nsec: 291331683 } })
29422025-08-12T22:47:51.052ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
29432025-08-12T22:47:51.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29442025-08-12T22:47:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29452025-08-12T22:47:51.054ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 11.028138ms iteration = 10 status = {"errors":[],"requests_created_ok":[]}
29462025-08-12T22:47:51.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29472025-08-12T22:47:51.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29482025-08-12T22:47:51.054ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29492025-08-12T22:47:51.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29502025-08-12T22:47:51.054ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29512025-08-12T22:47:51.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29522025-08-12T22:47:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29532025-08-12T22:47:51.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29542025-08-12T22:47:51.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29552025-08-12T22:47:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29562025-08-12T22:47:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29572025-08-12T22:47:51.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29582025-08-12T22:47:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29592025-08-12T22:47:51.057ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29602025-08-12T22:47:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29612025-08-12T22:47:51.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29622025-08-12T22:47:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29632025-08-12T22:47:51.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29642025-08-12T22:47:51.059ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29652025-08-12T22:47:51.059ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 16.147849ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29662025-08-12T22:47:51.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29672025-08-12T22:47:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29682025-08-12T22:47:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29692025-08-12T22:47:51.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29702025-08-12T22:47:51.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29712025-08-12T22:47:51.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29722025-08-12T22:47:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
29732025-08-12T22:47:51.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29742025-08-12T22:47:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29752025-08-12T22:47:51.080ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
29762025-08-12T22:47:51.081ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.099254ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
29772025-08-12T22:47:51.092ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29782025-08-12T22:47:51.094ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29792025-08-12T22:47:51.094ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29802025-08-12T22:47:51.094ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29812025-08-12T22:47:51.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29822025-08-12T22:47:51.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
29832025-08-12T22:47:51.095ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
29842025-08-12T22:47:51.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
29852025-08-12T22:47:51.097ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
29862025-08-12T22:47:51.097ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 54.694997ms iteration = 55 status = {"chicken_switches_updated":false}
29872025-08-12T22:47:51.100ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29882025-08-12T22:47:51.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29892025-08-12T22:47:51.102ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29902025-08-12T22:47:51.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29912025-08-12T22:47:51.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29922025-08-12T22:47:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29932025-08-12T22:47:51.104ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29942025-08-12T22:47:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29952025-08-12T22:47:51.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29962025-08-12T22:47:51.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29972025-08-12T22:47:51.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29982025-08-12T22:47:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29992025-08-12T22:47:51.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30002025-08-12T22:47:51.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 65.006778ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
30012025-08-12T22:47:51.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
30022025-08-12T22:47:51.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30032025-08-12T22:47:51.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30042025-08-12T22:47:51.111ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.020577ms iteration = 10 status = 0
30052025-08-12T22:47:51.138ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30062025-08-12T22:47:51.138ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30072025-08-12T22:47:51.138ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30082025-08-12T22:47:51.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30092025-08-12T22:47:51.142ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
30102025-08-12T22:47:51.142ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 99.593616ms iteration = 10 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
30112025-08-12T22:47:51.154ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
30122025-08-12T22:47:51.154ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30132025-08-12T22:47:51.154ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4a21bdc-85c3-47b4-b274-a02b60d3bec0", "content-length": "26", "date": "Tue, 12 Aug 2025 22:47:51 GMT"} })
30142025-08-12T22:47:51.154ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30152025-08-12T22:47:51.156ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30162025-08-12T22:47:51.164ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
30172025-08-12T22:47:51.164ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30182025-08-12T22:47:51.164ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "557ca2c6-af88-4cff-8a45-bf73c109bbb1", "content-length": "26", "date": "Tue, 12 Aug 2025 22:47:51 GMT"} })
30192025-08-12T22:47:51.164ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30202025-08-12T22:47:51.166ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30212025-08-12T22:47:51.179ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30222025-08-12T22:47:51.179ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30232025-08-12T22:47:51.180ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "52c94349-8f80-4402-8a9f-27407c1217a3", "content-length": "372", "date": "Tue, 12 Aug 2025 22:47:51 GMT"} })
30242025-08-12T22:47:51.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30252025-08-12T22:47:51.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30262025-08-12T22:47:51.180ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
30272025-08-12T22:47:51.180ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30282025-08-12T22:47:51.181ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "039cab0c-d322-47b5-b170-e50bd9b27036", "content-length": "26", "date": "Tue, 12 Aug 2025 22:47:51 GMT"} })
30292025-08-12T22:47:51.181ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30302025-08-12T22:47:51.182ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
30312025-08-12T22:47:51.185ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30322025-08-12T22:47:51.185ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30332025-08-12T22:47:51.185ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.289996ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30342025-08-12T22:47:51.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30352025-08-12T22:47:51.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30362025-08-12T22:47:51.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30372025-08-12T22:47:51.191ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30382025-08-12T22:47:51.191ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30392025-08-12T22:47:51.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30402025-08-12T22:47:51.193ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 150.084572ms iteration = 12 status = {"physical_disks_added":0}
30412025-08-12T22:47:51.194ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30422025-08-12T22:47:51.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30432025-08-12T22:47:51.196ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30442025-08-12T22:47:51.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30452025-08-12T22:47:51.230ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
30462025-08-12T22:47:51.230ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30472025-08-12T22:47:51.230ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3c627a20-4266-46ff-a7a7-5fa26430ba0d", "date": "Tue, 12 Aug 2025 22:47:51 GMT"} })
30482025-08-12T22:47:51.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30492025-08-12T22:47:51.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30502025-08-12T22:47:51.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30512025-08-12T22:47:51.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30522025-08-12T22:47:51.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30532025-08-12T22:47:51.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30542025-08-12T22:47:51.237ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30552025-08-12T22:47:51.237ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30562025-08-12T22:47:51.238ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2840db83-cd2f-446e-bac5-6a49b63516d2", "date": "Tue, 12 Aug 2025 22:47:51 GMT"} })
30572025-08-12T22:47:51.239ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 196.849151ms iteration = 10 status = {}
30582025-08-12T22:47:51.271ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30592025-08-12T22:47:51.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30602025-08-12T22:47:51.273ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 231.892644ms iteration = 10 status = null
30612025-08-12T22:47:51.312ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30622025-08-12T22:47:51.312ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ea74709-b43b-482f-8221-60e8786c4236", "content-length": "691", "date": "Tue, 12 Aug 2025 22:47:51 GMT"} })
30632025-08-12T22:47:51.312ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
30642025-08-12T22:47:51.312ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
30652025-08-12T22:47:51.312ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
30662025-08-12T22:47:51.314ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 271.510013ms iteration = 10 status = {}
30672025-08-12T22:47:51.351ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 309.330863ms iteration = 10 status = {}
30682025-08-12T22:47:51.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30692025-08-12T22:47:51.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30702025-08-12T22:47:51.458ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
30712025-08-12T22:47:51.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30722025-08-12T22:47:51.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30732025-08-12T22:47:51.474ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
30742025-08-12T22:47:51.474ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
30752025-08-12T22:47:51.474ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30762025-08-12T22:47:51.474ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30772025-08-12T22:47:51.474ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30782025-08-12T22:47:51.474ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30792025-08-12T22:47:51.474ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30802025-08-12T22:47:51.474ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30812025-08-12T22:47:51.475ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30822025-08-12T22:47:51.475ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30832025-08-12T22:47:51.475ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
30842025-08-12T22:47:51.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30852025-08-12T22:47:51.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30862025-08-12T22:47:51.478ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
30872025-08-12T22:47:51.478ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30882025-08-12T22:47:51.597ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "87bfdb74-11bc-48d8-af9d-d8c89a8c459c", "date": "Tue, 12 Aug 2025 22:47:51 GMT"} })
30892025-08-12T22:47:51.597ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
30902025-08-12T22:47:51.597ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30912025-08-12T22:47:51.597ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "627095ca-2869-4054-9cc0-5d916c97d2b2", "content-length": "682", "date": "Tue, 12 Aug 2025 22:47:51 GMT"} })
30922025-08-12T22:47:51.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30932025-08-12T22:47:51.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30942025-08-12T22:47:51.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30952025-08-12T22:47:51.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30962025-08-12T22:47:51.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30972025-08-12T22:47:51.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30982025-08-12T22:47:51.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30992025-08-12T22:47:51.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31002025-08-12T22:47:51.614ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 571.95518ms iteration = 10 status = {}
31012025-08-12T22:47:51.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3518f9d1-eace-4c19-bb59-ae2127b9c553 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31022025-08-12T22:47:51.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3518f9d1-eace-4c19-bb59-ae2127b9c553 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31032025-08-12T22:47:51.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3518f9d1-eace-4c19-bb59-ae2127b9c553 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31042025-08-12T22:47:52.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c7bced46-8100-4401-804e-7eb0c8f8c252 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31052025-08-12T22:47:52.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c7bced46-8100-4401-804e-7eb0c8f8c252 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31062025-08-12T22:47:52.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c7bced46-8100-4401-804e-7eb0c8f8c252 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31072025-08-12T22:47:53.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b93c2969-1f6a-4aa8-b9e7-78758fd3f101 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31082025-08-12T22:47:53.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b93c2969-1f6a-4aa8-b9e7-78758fd3f101 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31092025-08-12T22:47:53.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b93c2969-1f6a-4aa8-b9e7-78758fd3f101 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31102025-08-12T22:47:54.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 677e6b54-128e-4654-b0ca-aa9d60b0ff97 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31112025-08-12T22:47:54.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 677e6b54-128e-4654-b0ca-aa9d60b0ff97 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31122025-08-12T22:47:54.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 677e6b54-128e-4654-b0ca-aa9d60b0ff97 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31132025-08-12T22:47:55.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 88771c7a-5aa7-431a-bae3-25fe6ca09c5f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31142025-08-12T22:47:55.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 88771c7a-5aa7-431a-bae3-25fe6ca09c5f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31152025-08-12T22:47:55.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 88771c7a-5aa7-431a-bae3-25fe6ca09c5f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31162025-08-12T22:47:56.043ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 56 reason = Timeout
31172025-08-12T22:47:56.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
31182025-08-12T22:47:56.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
31192025-08-12T22:47:56.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31202025-08-12T22:47:56.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
31212025-08-12T22:47:56.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
31222025-08-12T22:47:56.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
31232025-08-12T22:47:56.051ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
31242025-08-12T22:47:56.051ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.853788ms iteration = 56 status = {"chicken_switches_updated":false}
31252025-08-12T22:47:56.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = db2f9e25-1dbd-4354-9b79-589e88203f7f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31262025-08-12T22:47:56.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = db2f9e25-1dbd-4354-9b79-589e88203f7f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31272025-08-12T22:47:56.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = db2f9e25-1dbd-4354-9b79-589e88203f7f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31282025-08-12T22:47:57.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5dc65749-0c6b-45eb-80e9-ddafbed0743c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31292025-08-12T22:47:57.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5dc65749-0c6b-45eb-80e9-ddafbed0743c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31302025-08-12T22:47:57.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5dc65749-0c6b-45eb-80e9-ddafbed0743c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31312025-08-12T22:47:58.831ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 574 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 2a3749a2-db1f-44f6-ae32-0bbab2da33d9 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
31322025-08-12T22:47:58.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f01e6f15-bdfa-42ed-a3f1-f8ad667cfb04 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31332025-08-12T22:47:58.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f01e6f15-bdfa-42ed-a3f1-f8ad667cfb04 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31342025-08-12T22:47:58.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f01e6f15-bdfa-42ed-a3f1-f8ad667cfb04 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31352025-08-12T22:47:59.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ae7baf11-2d87-4430-8294-5fe49a466704 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31362025-08-12T22:47:59.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ae7baf11-2d87-4430-8294-5fe49a466704 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31372025-08-12T22:47:59.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ae7baf11-2d87-4430-8294-5fe49a466704 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31382025-08-12T22:48:00.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0103e527-b403-4d39-814f-3d05ee7e3165 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31392025-08-12T22:48:00.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0103e527-b403-4d39-814f-3d05ee7e3165 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31402025-08-12T22:48:00.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0103e527-b403-4d39-814f-3d05ee7e3165 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31412025-08-12T22:48:01.042ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
31422025-08-12T22:48:01.043ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
31432025-08-12T22:48:01.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31442025-08-12T22:48:01.043ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 57 reason = Timeout
31452025-08-12T22:48:01.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31462025-08-12T22:48:01.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
31472025-08-12T22:48:01.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
31482025-08-12T22:48:01.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31492025-08-12T22:48:01.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31502025-08-12T22:48:01.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31512025-08-12T22:48:01.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31522025-08-12T22:48:01.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31532025-08-12T22:48:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31542025-08-12T22:48:01.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.273892ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31552025-08-12T22:48:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
31562025-08-12T22:48:01.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
31572025-08-12T22:48:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
31582025-08-12T22:48:01.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31592025-08-12T22:48:01.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31602025-08-12T22:48:01.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31612025-08-12T22:48:01.050ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
31622025-08-12T22:48:01.050ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.612284ms iteration = 57 status = {"chicken_switches_updated":false}
31632025-08-12T22:48:01.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31642025-08-12T22:48:01.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31652025-08-12T22:48:01.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31662025-08-12T22:48:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
31672025-08-12T22:48:01.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31682025-08-12T22:48:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31692025-08-12T22:48:01.067ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
31702025-08-12T22:48:01.067ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.57443ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
31712025-08-12T22:48:01.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 645d50cc-9e76-4b9d-a1c5-4ca0cb5e8915 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31722025-08-12T22:48:01.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 645d50cc-9e76-4b9d-a1c5-4ca0cb5e8915 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31732025-08-12T22:48:01.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 645d50cc-9e76-4b9d-a1c5-4ca0cb5e8915 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31742025-08-12T22:48:02.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4a3c070a-5189-41c1-9403-b9551e0d60b1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31752025-08-12T22:48:02.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4a3c070a-5189-41c1-9403-b9551e0d60b1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31762025-08-12T22:48:02.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4a3c070a-5189-41c1-9403-b9551e0d60b1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31772025-08-12T22:48:03.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c65a667e-7c9c-4607-a08b-e3639a754183 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31782025-08-12T22:48:03.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c65a667e-7c9c-4607-a08b-e3639a754183 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31792025-08-12T22:48:03.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c65a667e-7c9c-4607-a08b-e3639a754183 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31802025-08-12T22:48:05.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c568cd81-94b0-4088-ba73-71613bb8c66f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31812025-08-12T22:48:05.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c568cd81-94b0-4088-ba73-71613bb8c66f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31822025-08-12T22:48:05.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c568cd81-94b0-4088-ba73-71613bb8c66f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31832025-08-12T22:48:06.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1c28ed7b-4451-4459-9f6c-2539062ae899 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31842025-08-12T22:48:06.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1c28ed7b-4451-4459-9f6c-2539062ae899 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31852025-08-12T22:48:06.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1c28ed7b-4451-4459-9f6c-2539062ae899 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31862025-08-12T22:48:06.043ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 58 reason = Timeout
31872025-08-12T22:48:06.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
31882025-08-12T22:48:06.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
31892025-08-12T22:48:06.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31902025-08-12T22:48:06.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
31912025-08-12T22:48:06.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
31922025-08-12T22:48:06.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
31932025-08-12T22:48:06.050ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
31942025-08-12T22:48:06.050ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.867217ms iteration = 58 status = {"chicken_switches_updated":false}
31952025-08-12T22:48:07.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 619eaa35-4fa6-4bfb-b6d1-b56409fac90a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31962025-08-12T22:48:07.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 619eaa35-4fa6-4bfb-b6d1-b56409fac90a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31972025-08-12T22:48:07.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 619eaa35-4fa6-4bfb-b6d1-b56409fac90a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31982025-08-12T22:48:08.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 565a8f32-f80b-4854-8430-f7868eb20a65 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
31992025-08-12T22:48:08.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 565a8f32-f80b-4854-8430-f7868eb20a65 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32002025-08-12T22:48:08.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 565a8f32-f80b-4854-8430-f7868eb20a65 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32012025-08-12T22:48:08.831ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 550 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = d2f7657c-9461-43b4-bb45-890069e44868 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
32022025-08-12T22:48:09.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eb0e10ad-7353-4fe8-b669-ac9972b91bd5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32032025-08-12T22:48:09.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eb0e10ad-7353-4fe8-b669-ac9972b91bd5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32042025-08-12T22:48:09.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eb0e10ad-7353-4fe8-b669-ac9972b91bd5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32052025-08-12T22:48:10.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fbbf1e5b-0382-4af8-9bc5-baabae2399a9 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32062025-08-12T22:48:10.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fbbf1e5b-0382-4af8-9bc5-baabae2399a9 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32072025-08-12T22:48:10.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fbbf1e5b-0382-4af8-9bc5-baabae2399a9 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32082025-08-12T22:48:11.043ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
32092025-08-12T22:48:11.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32102025-08-12T22:48:11.043ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
32112025-08-12T22:48:11.043ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 59 reason = Timeout
32122025-08-12T22:48:11.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
32132025-08-12T22:48:11.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32142025-08-12T22:48:11.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32152025-08-12T22:48:11.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
32162025-08-12T22:48:11.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32172025-08-12T22:48:11.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32182025-08-12T22:48:11.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32192025-08-12T22:48:11.046ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32202025-08-12T22:48:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32212025-08-12T22:48:11.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.510454ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32222025-08-12T22:48:11.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32232025-08-12T22:48:11.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32242025-08-12T22:48:11.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32252025-08-12T22:48:11.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
32262025-08-12T22:48:11.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
32272025-08-12T22:48:11.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
32282025-08-12T22:48:11.051ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
32292025-08-12T22:48:11.051ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.10115ms iteration = 59 status = {"chicken_switches_updated":false}
32302025-08-12T22:48:11.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32312025-08-12T22:48:11.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32322025-08-12T22:48:11.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32332025-08-12T22:48:11.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
32342025-08-12T22:48:11.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32352025-08-12T22:48:11.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32362025-08-12T22:48:11.069ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
32372025-08-12T22:48:11.069ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.249247ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
32382025-08-12T22:48:11.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6261c9f2-3913-4a38-a95a-4fb93a87b9d2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32392025-08-12T22:48:11.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6261c9f2-3913-4a38-a95a-4fb93a87b9d2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32402025-08-12T22:48:11.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6261c9f2-3913-4a38-a95a-4fb93a87b9d2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32412025-08-12T22:48:12.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1b40e6e7-a4ee-4e64-9d62-1a375c7dabe2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32422025-08-12T22:48:12.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1b40e6e7-a4ee-4e64-9d62-1a375c7dabe2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32432025-08-12T22:48:12.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1b40e6e7-a4ee-4e64-9d62-1a375c7dabe2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32442025-08-12T22:48:13.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e3ea20c5-0820-44a4-b3ee-9c670e916844 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32452025-08-12T22:48:13.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e3ea20c5-0820-44a4-b3ee-9c670e916844 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32462025-08-12T22:48:13.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e3ea20c5-0820-44a4-b3ee-9c670e916844 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32472025-08-12T22:48:13.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = 473b4dc1-9d2c-4f9b-aedd-2068ac8c1e8b roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
32482025-08-12T22:48:13.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = 473b4dc1-9d2c-4f9b-aedd-2068ac8c1e8b resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
32492025-08-12T22:48:13.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = 473b4dc1-9d2c-4f9b-aedd-2068ac8c1e8b response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
32502025-08-12T22:48:13.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = f03accd4-efd1-471a-bfff-7a9239ca283f roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
32512025-08-12T22:48:13.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = f03accd4-efd1-471a-bfff-7a9239ca283f resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
32522025-08-12T22:48:13.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:53275 req_id = f03accd4-efd1-471a-bfff-7a9239ca283f response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
32532025-08-12T22:48:14.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 14be9836-dea0-4a48-84e2-25de50dea5d1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32542025-08-12T22:48:14.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 14be9836-dea0-4a48-84e2-25de50dea5d1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32552025-08-12T22:48:14.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 14be9836-dea0-4a48-84e2-25de50dea5d1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32562025-08-12T22:48:15.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7fac8c8b-49b0-4916-b096-5744b3d2b012 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32572025-08-12T22:48:15.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7fac8c8b-49b0-4916-b096-5744b3d2b012 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32582025-08-12T22:48:15.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7fac8c8b-49b0-4916-b096-5744b3d2b012 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32592025-08-12T22:48:16.043ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 60 reason = Timeout
32602025-08-12T22:48:16.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
32612025-08-12T22:48:16.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
32622025-08-12T22:48:16.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32632025-08-12T22:48:16.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
32642025-08-12T22:48:16.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
32652025-08-12T22:48:16.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
32662025-08-12T22:48:16.050ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
32672025-08-12T22:48:16.050ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.363533ms iteration = 60 status = {"chicken_switches_updated":false}
32682025-08-12T22:48:16.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4cc5a185-5ec1-429d-ba6b-caf8659c99a2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32692025-08-12T22:48:16.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4cc5a185-5ec1-429d-ba6b-caf8659c99a2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32702025-08-12T22:48:16.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4cc5a185-5ec1-429d-ba6b-caf8659c99a2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32712025-08-12T22:48:17.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f173924a-3982-4a15-9876-f7145e69902d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32722025-08-12T22:48:17.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f173924a-3982-4a15-9876-f7145e69902d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32732025-08-12T22:48:17.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f173924a-3982-4a15-9876-f7145e69902d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32742025-08-12T22:48:18.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f72f081f-cb13-46ef-8368-c3eb5d0d000c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32752025-08-12T22:48:18.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f72f081f-cb13-46ef-8368-c3eb5d0d000c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32762025-08-12T22:48:18.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f72f081f-cb13-46ef-8368-c3eb5d0d000c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32772025-08-12T22:48:18.831ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 706 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 4d9398fb-fcf2-40e5-b986-ddabdb29d9bf response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
32782025-08-12T22:48:19.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 560d4bed-4478-4bc6-8435-fa435770b3d4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32792025-08-12T22:48:19.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 560d4bed-4478-4bc6-8435-fa435770b3d4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32802025-08-12T22:48:19.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 560d4bed-4478-4bc6-8435-fa435770b3d4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32812025-08-12T22:48:20.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = adfe9e8a-f492-4517-88d0-4c5188952974 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32822025-08-12T22:48:20.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = adfe9e8a-f492-4517-88d0-4c5188952974 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32832025-08-12T22:48:20.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = adfe9e8a-f492-4517-88d0-4c5188952974 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
32842025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
32852025-08-12T22:48:21.043ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0
32862025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
32872025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.39\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0"}
32882025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
32892025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32902025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32912025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
32922025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
32932025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
32942025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
32952025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32962025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
32972025-08-12T22:48:21.043ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-12 22:38:21.043137576 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
32982025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
32992025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
33002025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
33012025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33022025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
33032025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
33042025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33052025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
33062025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
33072025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Timeout
33082025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
33092025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
33102025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33112025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
33122025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
33132025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 11 reason = Timeout
33142025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 14.58\u{b5}s iteration = 11 status = {"disabled":true,"errors":[],"sps":[]}
33152025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 9 reason = Timeout
33162025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
33172025-08-12T22:48:21.043ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
33182025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
33192025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 8.41\u{b5}s iteration = 9 status = "Disabled"
33202025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
33212025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33222025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 2 reason = Timeout
33232025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33242025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
33252025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
33262025-08-12T22:48:21.043ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
33272025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33282025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
33292025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33302025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
33312025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33322025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
33332025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33342025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
33352025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33362025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
33372025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
33382025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 6 reason = Timeout
33392025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
33402025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33412025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 6 reason = Timeout
33422025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
33432025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
33442025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33452025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
33462025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33472025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
33482025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33492025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33502025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33512025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
33522025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 61 reason = Timeout
33532025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33542025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
33552025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 11 reason = Timeout
33562025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
33572025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
33582025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33592025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
33602025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33612025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33622025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
33632025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33642025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
33652025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
33662025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
33672025-08-12T22:48:21.043ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
33682025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33692025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33702025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
33712025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33722025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33732025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33742025-08-12T22:48:21.043ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3e3264d-303d-4ce7-a0ce-0090b10b154f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1303, tv_nsec: 282234513 } })
33752025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33762025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33772025-08-12T22:48:21.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33782025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
33792025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33802025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33812025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33822025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
33832025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33842025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33852025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33862025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
33872025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33882025-08-12T22:48:21.044ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("043b8097-0e38-4228-bada-dac70e518148.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26cd5275-57f5-4466-a94f-f96956f55588.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1303, tv_nsec: 282590956 } })
33892025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33902025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33912025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
33922025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33932025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
33942025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33952025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33962025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33972025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33982025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
33992025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34002025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34012025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
34022025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.231063ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
34032025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34042025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34052025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34062025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34072025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
34082025-08-12T22:48:21.044ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.656866ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
34092025-08-12T22:48:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34102025-08-12T22:48:21.045ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34112025-08-12T22:48:21.046ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1303, tv_nsec: 284386084 } })
34122025-08-12T22:48:21.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34132025-08-12T22:48:21.046ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34142025-08-12T22:48:21.046ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34152025-08-12T22:48:21.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34162025-08-12T22:48:21.046ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
34172025-08-12T22:48:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.011669ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
34182025-08-12T22:48:21.046ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-12 22:38:21.043137576 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34192025-08-12T22:48:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.471284ms iteration = 6 status = {"expiration":"2025-08-12T22:38:21.043137576Z","pruned":[]}
34202025-08-12T22:48:21.050ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
34212025-08-12T22:48:21.050ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
34222025-08-12T22:48:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
34232025-08-12T22:48:21.050ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34242025-08-12T22:48:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34252025-08-12T22:48:21.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34262025-08-12T22:48:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
34272025-08-12T22:48:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34282025-08-12T22:48:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34292025-08-12T22:48:21.051ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1303, tv_nsec: 289519864 } })
34302025-08-12T22:48:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
34312025-08-12T22:48:21.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34322025-08-12T22:48:21.052ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
34332025-08-12T22:48:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34342025-08-12T22:48:21.054ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
34352025-08-12T22:48:21.054ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
34362025-08-12T22:48:21.054ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.950418ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
34372025-08-12T22:48:21.055ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 12.343821ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34382025-08-12T22:48:21.055ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34392025-08-12T22:48:21.055ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34402025-08-12T22:48:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34412025-08-12T22:48:21.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34422025-08-12T22:48:21.056ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
34432025-08-12T22:48:21.056ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 13.370491ms iteration = 6 status = {"by_rx":{},"error":null}
34442025-08-12T22:48:21.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34452025-08-12T22:48:21.057ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34462025-08-12T22:48:21.057ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34472025-08-12T22:48:21.058ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.082828ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
34482025-08-12T22:48:21.059ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34492025-08-12T22:48:21.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34502025-08-12T22:48:21.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34512025-08-12T22:48:21.059ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34522025-08-12T22:48:21.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34532025-08-12T22:48:21.059ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
34542025-08-12T22:48:21.059ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34552025-08-12T22:48:21.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34562025-08-12T22:48:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34572025-08-12T22:48:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
34582025-08-12T22:48:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34592025-08-12T22:48:21.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34602025-08-12T22:48:21.060ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34612025-08-12T22:48:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34622025-08-12T22:48:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34632025-08-12T22:48:21.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34642025-08-12T22:48:21.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 18.080557ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34652025-08-12T22:48:21.061ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.137388ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
34662025-08-12T22:48:21.061ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34672025-08-12T22:48:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34682025-08-12T22:48:21.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
34692025-08-12T22:48:21.062ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1303, tv_nsec: 300654623 } })
34702025-08-12T22:48:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34712025-08-12T22:48:21.062ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34722025-08-12T22:48:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
34732025-08-12T22:48:21.062ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
34742025-08-12T22:48:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34752025-08-12T22:48:21.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 19.678193ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34762025-08-12T22:48:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34772025-08-12T22:48:21.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34782025-08-12T22:48:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34792025-08-12T22:48:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34802025-08-12T22:48:21.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34812025-08-12T22:48:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34822025-08-12T22:48:21.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34832025-08-12T22:48:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34842025-08-12T22:48:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34852025-08-12T22:48:21.065ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34862025-08-12T22:48:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34872025-08-12T22:48:21.065ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34882025-08-12T22:48:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34892025-08-12T22:48:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34902025-08-12T22:48:21.068ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 23.810323ms iteration = 6 status = {"dispatched":[],"errors":[],"glob_version":"180.0.0","globs_reprocessed":{},"no_receivers":[]}
34912025-08-12T22:48:21.068ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34922025-08-12T22:48:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34932025-08-12T22:48:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34942025-08-12T22:48:21.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34952025-08-12T22:48:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34962025-08-12T22:48:21.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34972025-08-12T22:48:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34982025-08-12T22:48:21.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34992025-08-12T22:48:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
35002025-08-12T22:48:21.069ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
35012025-08-12T22:48:21.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35022025-08-12T22:48:21.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35032025-08-12T22:48:21.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
35042025-08-12T22:48:21.069ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
35052025-08-12T22:48:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
35062025-08-12T22:48:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
35072025-08-12T22:48:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35082025-08-12T22:48:21.069ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35092025-08-12T22:48:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35102025-08-12T22:48:21.070ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35112025-08-12T22:48:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35122025-08-12T22:48:21.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35132025-08-12T22:48:21.070ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 27.121946ms iteration = 11 status = {"errors":[],"requests_created_ok":[]}
35142025-08-12T22:48:21.070ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35152025-08-12T22:48:21.070ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35162025-08-12T22:48:21.070ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35172025-08-12T22:48:21.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35182025-08-12T22:48:21.070ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35192025-08-12T22:48:21.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35202025-08-12T22:48:21.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35212025-08-12T22:48:21.071ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
35222025-08-12T22:48:21.071ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 28.053456ms iteration = 61 status = {"chicken_switches_updated":false}
35232025-08-12T22:48:21.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35242025-08-12T22:48:21.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35252025-08-12T22:48:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35262025-08-12T22:48:21.072ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35272025-08-12T22:48:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35282025-08-12T22:48:21.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35292025-08-12T22:48:21.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35302025-08-12T22:48:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35312025-08-12T22:48:21.072ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35322025-08-12T22:48:21.072ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
35332025-08-12T22:48:21.072ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 29.443919ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35342025-08-12T22:48:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35352025-08-12T22:48:21.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35362025-08-12T22:48:21.074ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35372025-08-12T22:48:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
35382025-08-12T22:48:21.074ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35392025-08-12T22:48:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
35402025-08-12T22:48:21.074ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35412025-08-12T22:48:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35422025-08-12T22:48:21.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35432025-08-12T22:48:21.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35442025-08-12T22:48:21.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35452025-08-12T22:48:21.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35462025-08-12T22:48:21.077ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35472025-08-12T22:48:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35482025-08-12T22:48:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
35492025-08-12T22:48:21.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35502025-08-12T22:48:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35512025-08-12T22:48:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35522025-08-12T22:48:21.079ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35532025-08-12T22:48:21.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35542025-08-12T22:48:21.080ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35552025-08-12T22:48:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
35562025-08-12T22:48:21.081ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35572025-08-12T22:48:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35582025-08-12T22:48:21.083ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35592025-08-12T22:48:21.083ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35602025-08-12T22:48:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35612025-08-12T22:48:21.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35622025-08-12T22:48:21.083ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 40.408066ms iteration = 13 status = {"physical_disks_added":0}
35632025-08-12T22:48:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35642025-08-12T22:48:21.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35652025-08-12T22:48:21.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35662025-08-12T22:48:21.088ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35672025-08-12T22:48:21.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
35682025-08-12T22:48:21.092ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35692025-08-12T22:48:21.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35702025-08-12T22:48:21.094ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
35712025-08-12T22:48:21.094ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.94217ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
35722025-08-12T22:48:21.095ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35732025-08-12T22:48:21.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35742025-08-12T22:48:21.098ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35752025-08-12T22:48:21.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35762025-08-12T22:48:21.104ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35772025-08-12T22:48:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35782025-08-12T22:48:21.108ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35792025-08-12T22:48:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35802025-08-12T22:48:21.110ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35812025-08-12T22:48:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35822025-08-12T22:48:21.111ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35832025-08-12T22:48:21.111ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35842025-08-12T22:48:21.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35852025-08-12T22:48:21.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35862025-08-12T22:48:21.112ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35872025-08-12T22:48:21.112ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35882025-08-12T22:48:21.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35892025-08-12T22:48:21.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35902025-08-12T22:48:21.113ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35912025-08-12T22:48:21.113ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35922025-08-12T22:48:21.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35932025-08-12T22:48:21.114ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.160678ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35942025-08-12T22:48:21.116ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35952025-08-12T22:48:21.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35962025-08-12T22:48:21.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 74.753063ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
35972025-08-12T22:48:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
35982025-08-12T22:48:21.118ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35992025-08-12T22:48:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36002025-08-12T22:48:21.120ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36012025-08-12T22:48:21.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36022025-08-12T22:48:21.123ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36032025-08-12T22:48:21.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36042025-08-12T22:48:21.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36052025-08-12T22:48:21.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36062025-08-12T22:48:21.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36072025-08-12T22:48:21.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36082025-08-12T22:48:21.124ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
36092025-08-12T22:48:21.124ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
36102025-08-12T22:48:21.124ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
36112025-08-12T22:48:21.124ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36122025-08-12T22:48:21.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36132025-08-12T22:48:21.125ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36142025-08-12T22:48:21.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36152025-08-12T22:48:21.126ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36162025-08-12T22:48:21.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36172025-08-12T22:48:21.126ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36182025-08-12T22:48:21.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36192025-08-12T22:48:21.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36202025-08-12T22:48:21.129ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
36212025-08-12T22:48:21.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36222025-08-12T22:48:21.129ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36232025-08-12T22:48:21.129ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.515839ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36242025-08-12T22:48:21.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36252025-08-12T22:48:21.129ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
36262025-08-12T22:48:21.129ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 85.835332ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
36272025-08-12T22:48:21.129ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36282025-08-12T22:48:21.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36292025-08-12T22:48:21.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36302025-08-12T22:48:21.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36312025-08-12T22:48:21.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36322025-08-12T22:48:21.130ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36332025-08-12T22:48:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
36342025-08-12T22:48:21.131ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36352025-08-12T22:48:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36362025-08-12T22:48:21.131ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36372025-08-12T22:48:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36382025-08-12T22:48:21.132ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
36392025-08-12T22:48:21.132ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
36402025-08-12T22:48:21.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36412025-08-12T22:48:21.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36422025-08-12T22:48:21.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
36432025-08-12T22:48:21.133ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36442025-08-12T22:48:21.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36452025-08-12T22:48:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36462025-08-12T22:48:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36472025-08-12T22:48:21.133ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.078183ms iteration = 11 status = 0
36482025-08-12T22:48:21.134ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36492025-08-12T22:48:21.134ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
36502025-08-12T22:48:21.134ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 0 version = 2
36512025-08-12T22:48:21.134ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36522025-08-12T22:48:21.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36532025-08-12T22:48:21.134ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36542025-08-12T22:48:21.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36552025-08-12T22:48:21.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36562025-08-12T22:48:21.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36572025-08-12T22:48:21.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36582025-08-12T22:48:21.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36592025-08-12T22:48:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36602025-08-12T22:48:21.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36612025-08-12T22:48:21.140ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36622025-08-12T22:48:21.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36632025-08-12T22:48:21.141ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36642025-08-12T22:48:21.142ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
36652025-08-12T22:48:21.142ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36662025-08-12T22:48:21.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36672025-08-12T22:48:21.142ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 4 version = 2
36682025-08-12T22:48:21.142ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
36692025-08-12T22:48:21.142ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-12 22:43:50.527483 UTC dns_group = external generation = 2
36702025-08-12T22:48:21.142ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 99.455866ms iteration = 6 status = {"generation":2}
36712025-08-12T22:48:21.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36722025-08-12T22:48:21.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36732025-08-12T22:48:21.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
36742025-08-12T22:48:21.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36752025-08-12T22:48:21.144ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
36762025-08-12T22:48:21.144ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
36772025-08-12T22:48:21.144ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-12 22:43:49.909589 UTC dns_group = internal generation = 1
36782025-08-12T22:48:21.144ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 101.024241ms iteration = 6 status = {"generation":1}
36792025-08-12T22:48:21.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36802025-08-12T22:48:21.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36812025-08-12T22:48:21.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36822025-08-12T22:48:21.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36832025-08-12T22:48:21.146ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36842025-08-12T22:48:21.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
36852025-08-12T22:48:21.147ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
36862025-08-12T22:48:21.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
36872025-08-12T22:48:21.148ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-12T22:43:09.981233Z, time_modified: 2025-08-12T22:43:09.981233Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }) }
36882025-08-12T22:48:21.148ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 105.521895ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]}},"default_endpoint":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
36892025-08-12T22:48:21.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
36902025-08-12T22:48:21.153ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36912025-08-12T22:48:21.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36922025-08-12T22:48:21.158ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36932025-08-12T22:48:21.158ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36942025-08-12T22:48:21.158ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36952025-08-12T22:48:21.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36962025-08-12T22:48:21.158ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36972025-08-12T22:48:21.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36982025-08-12T22:48:21.159ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
36992025-08-12T22:48:21.162ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 116.520213ms iteration = 4 status = {"blueprint_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","inventory_collection_id":"0e0393a2-6072-45ae-a671-a6b7e14ef5c0","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
37002025-08-12T22:48:21.162ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37012025-08-12T22:48:21.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37022025-08-12T22:48:21.162ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37032025-08-12T22:48:21.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37042025-08-12T22:48:21.164ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37052025-08-12T22:48:21.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37062025-08-12T22:48:21.167ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37072025-08-12T22:48:21.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37082025-08-12T22:48:21.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37092025-08-12T22:48:21.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37102025-08-12T22:48:21.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37112025-08-12T22:48:21.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37122025-08-12T22:48:21.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37132025-08-12T22:48:21.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
37142025-08-12T22:48:21.177ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37152025-08-12T22:48:21.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37162025-08-12T22:48:21.178ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37172025-08-12T22:48:21.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37182025-08-12T22:48:21.179ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37192025-08-12T22:48:21.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37202025-08-12T22:48:21.181ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37212025-08-12T22:48:21.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
37222025-08-12T22:48:21.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37232025-08-12T22:48:21.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37242025-08-12T22:48:21.193ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: c4b020d9-d7fd-4254-9df0-03a251a659ea, kind: Service { id: a3e3264d-303d-4ce7-a0ce-0090b10b154f }, name: Name("external-dns-a3e3264d-303d-4ce7-a0ce-0090b10b154f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dd861cef-e068-45c3-a33b-98735de0368c, kind: Service { id: d7d2275f-b0bb-4a69-bcc5-687d9e81abaf }, name: Name("external-dns-d7d2275f-b0bb-4a69-bcc5-687d9e81abaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 228])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 4fe06a86-0026-42b1-a394-38f25f72f387, kind: Service { id: 8c95eed0-ca33-44fa-9752-6c25556f7542 }, name: Name("nexus-8c95eed0-ca33-44fa-9752-6c25556f7542"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 72a54743-6163-4f5e-82c8-d7c201ff8d1c, kind: Service { id: 01906d6c-0b9c-44b5-804a-5f066c00adfe }, name: Name("nexus-01906d6c-0b9c-44b5-804a-5f066c00adfe"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d4b52e5a-04f2-45f1-94e6-23afee047fbf, kind: Service { id: 8ce01a52-aeb2-40b4-aa3d-1f24db666e92 }, name: Name("nexus-8ce01a52-aeb2-40b4-aa3d-1f24db666e92"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
37252025-08-12T22:48:21.193ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37262025-08-12T22:48:21.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37272025-08-12T22:48:21.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37282025-08-12T22:48:21.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
37292025-08-12T22:48:21.196ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37302025-08-12T22:48:21.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37312025-08-12T22:48:21.198ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
37322025-08-12T22:48:21.198ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c4b020d9-d7fd-4254-9df0-03a251a659ea, kind: Service { id: a3e3264d-303d-4ce7-a0ce-0090b10b154f }, name: Name("external-dns-a3e3264d-303d-4ce7-a0ce-0090b10b154f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dd861cef-e068-45c3-a33b-98735de0368c, kind: Service { id: d7d2275f-b0bb-4a69-bcc5-687d9e81abaf }, name: Name("external-dns-d7d2275f-b0bb-4a69-bcc5-687d9e81abaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 228])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4fe06a86-0026-42b1-a394-38f25f72f387, kind: Service { id: 8c95eed0-ca33-44fa-9752-6c25556f7542 }, name: Name("nexus-8c95eed0-ca33-44fa-9752-6c25556f7542"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 72a54743-6163-4f5e-82c8-d7c201ff8d1c, kind: Service { id: 01906d6c-0b9c-44b5-804a-5f066c00adfe }, name: Name("nexus-01906d6c-0b9c-44b5-804a-5f066c00adfe"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d4b52e5a-04f2-45f1-94e6-23afee047fbf, kind: Service { id: 8ce01a52-aeb2-40b4-aa3d-1f24db666e92 }, name: Name("nexus-8ce01a52-aeb2-40b4-aa3d-1f24db666e92"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c4b020d9-d7fd-4254-9df0-03a251a659ea, kind: Service { id: a3e3264d-303d-4ce7-a0ce-0090b10b154f }, name: Name("external-dns-a3e3264d-303d-4ce7-a0ce-0090b10b154f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dd861cef-e068-45c3-a33b-98735de0368c, kind: Service { id: d7d2275f-b0bb-4a69-bcc5-687d9e81abaf }, name: Name("external-dns-d7d2275f-b0bb-4a69-bcc5-687d9e81abaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 228])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4fe06a86-0026-42b1-a394-38f25f72f387, kind: Service { id: 8c95eed0-ca33-44fa-9752-6c25556f7542 }, name: Name("nexus-8c95eed0-ca33-44fa-9752-6c25556f7542"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 72a54743-6163-4f5e-82c8-d7c201ff8d1c, kind: Service { id: 01906d6c-0b9c-44b5-804a-5f066c00adfe }, name: Name("nexus-01906d6c-0b9c-44b5-804a-5f066c00adfe"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d4b52e5a-04f2-45f1-94e6-23afee047fbf, kind: Service { id: 8ce01a52-aeb2-40b4-aa3d-1f24db666e92 }, name: Name("nexus-8ce01a52-aeb2-40b4-aa3d-1f24db666e92"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
37332025-08-12T22:48:21.198ZDEBGnexus (service-firewall-rule-progator): resolved 3 rules for sleds background_task = service_firewall_rule_propagation
37342025-08-12T22:48:21.200ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37352025-08-12T22:48:21.200ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37362025-08-12T22:48:21.200ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.815288ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37372025-08-12T22:48:21.207ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
37382025-08-12T22:48:21.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
37392025-08-12T22:48:21.211ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37402025-08-12T22:48:21.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37412025-08-12T22:48:21.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37422025-08-12T22:48:21.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37432025-08-12T22:48:21.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37442025-08-12T22:48:21.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37452025-08-12T22:48:21.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37462025-08-12T22:48:21.217ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37472025-08-12T22:48:21.217ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37482025-08-12T22:48:21.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37492025-08-12T22:48:21.259ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: d04697ae-b4b1-419d-b9da-432e45c93990, time_created: 2025-08-12T22:43:47.338146Z, time_modified: 2025-08-12T22:43:47.338146Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348), cpu_family: AmdMilan }]
37502025-08-12T22:48:21.259ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
37512025-08-12T22:48:21.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 92c912a0-4d1d-40f9-b275-7fd5884a1df9 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
37522025-08-12T22:48:21.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 92c912a0-4d1d-40f9-b275-7fd5884a1df9 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
37532025-08-12T22:48:21.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 92c912a0-4d1d-40f9-b275-7fd5884a1df9 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
37542025-08-12T22:48:21.288ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
37552025-08-12T22:48:21.288ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37562025-08-12T22:48:21.289ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88e4794a-7e2c-4496-b59d-6b157dd80691", "content-length": "26", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} })
37572025-08-12T22:48:21.289ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37582025-08-12T22:48:21.291ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
37592025-08-12T22:48:21.343ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
37602025-08-12T22:48:21.343ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 299.71815ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
37612025-08-12T22:48:21.515ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
37622025-08-12T22:48:21.531ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
37632025-08-12T22:48:21.531ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37642025-08-12T22:48:21.531ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "308ec45f-cf61-4262-a0a9-c407aa586190", "content-length": "26", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} })
37652025-08-12T22:48:21.531ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37662025-08-12T22:48:21.533ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37672025-08-12T22:48:21.541ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
37682025-08-12T22:48:21.558ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37692025-08-12T22:48:21.559ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f5f727b-4469-41d6-97e0-8ee3575be707", "content-length": "691", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} })
37702025-08-12T22:48:21.559ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37712025-08-12T22:48:21.559ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37722025-08-12T22:48:21.559ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37732025-08-12T22:48:21.560ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 516.662137ms iteration = 11 status = {}
37742025-08-12T22:48:21.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37752025-08-12T22:48:21.588ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
37762025-08-12T22:48:21.588ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37772025-08-12T22:48:21.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37782025-08-12T22:48:21.588ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63d77bd0-7332-4260-92c1-bcb1ddc6d886", "content-length": "26", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} })
37792025-08-12T22:48:21.588ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37802025-08-12T22:48:21.590ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37812025-08-12T22:48:21.590ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37822025-08-12T22:48:21.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37832025-08-12T22:48:21.591ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37842025-08-12T22:48:21.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
37852025-08-12T22:48:21.604ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
37862025-08-12T22:48:21.605ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "bf9a1ab5-8d52-44ee-b570-1bbc7170c99b", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} })
37872025-08-12T22:48:21.606ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37882025-08-12T22:48:21.606ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37892025-08-12T22:48:21.606ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:491
37902025-08-12T22:48:21.606ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 563.454207ms
37912025-08-12T22:48:21.606ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 563.480377ms iteration = 2 status = {}
37922025-08-12T22:48:21.606ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff37b869-0619-4bd8-bd25-edd0913a0c08", "content-length": "372", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} })
37932025-08-12T22:48:21.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37942025-08-12T22:48:21.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37952025-08-12T22:48:21.628ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
37962025-08-12T22:48:21.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
37972025-08-12T22:48:21.631ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37982025-08-12T22:48:21.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
37992025-08-12T22:48:21.632ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
38002025-08-12T22:48:21.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
38012025-08-12T22:48:21.642ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
38022025-08-12T22:48:21.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
38032025-08-12T22:48:21.644ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38042025-08-12T22:48:21.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
38052025-08-12T22:48:21.645ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
38062025-08-12T22:48:21.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
38072025-08-12T22:48:21.664ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
38082025-08-12T22:48:21.664ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38092025-08-12T22:48:21.665ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a679f405-9ef1-49fd-a739-0869a0b5e9c3", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} })
38102025-08-12T22:48:21.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38112025-08-12T22:48:21.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38122025-08-12T22:48:21.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38132025-08-12T22:48:21.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38142025-08-12T22:48:21.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38152025-08-12T22:48:21.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38162025-08-12T22:48:21.677ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38172025-08-12T22:48:21.677ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38182025-08-12T22:48:21.677ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b299c597-8ef3-468c-872b-8b1ebcae16df", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} })
38192025-08-12T22:48:21.680ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 636.376082ms iteration = 11 status = {}
38202025-08-12T22:48:21.736ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
38212025-08-12T22:48:21.748ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38222025-08-12T22:48:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38232025-08-12T22:48:21.751ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 707.996773ms iteration = 11 status = null
38242025-08-12T22:48:21.757ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
38252025-08-12T22:48:21.758ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "5b03342a-4f74-4415-ad8a-b8f1a1b62476", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} })
38262025-08-12T22:48:21.758ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
38272025-08-12T22:48:21.758ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "f907a160-b8a1-4290-9043-7687bd176510", "content-length": "26", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} })
38282025-08-12T22:48:21.763ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:672 sled = http://[fd00:1122:3344:101::1]:12345
38292025-08-12T22:48:21.764ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 721.194543ms iteration = 2 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"d04697ae-b4b1-419d-b9da-432e45c93990","time":"2025-08-12T22:48:21.758143188Z"},{"operation":"list","target_sled":"d04697ae-b4b1-419d-b9da-432e45c93990","time":"2025-08-12T22:48:21.763211117Z"}]}
38302025-08-12T22:48:21.858ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
38312025-08-12T22:48:21.858ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5996c17e-86f5-47cd-8838-4e425414439e", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38322025-08-12T22:48:21.858ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38332025-08-12T22:48:21.860ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "61f18315-abfa-4a50-b58f-1e76b8ac18b1", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38342025-08-12T22:48:21.860ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38352025-08-12T22:48:21.862ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38362025-08-12T22:48:21.862ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 819.349975ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
38372025-08-12T22:48:21.864ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 821.345504ms iteration = 11 status = {}
38382025-08-12T22:48:21.871ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
38392025-08-12T22:48:21.871ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3f6cff96-864c-4011-bca6-148803e43b2d", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
38402025-08-12T22:48:21.871ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
38412025-08-12T22:48:21.873ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "647055a6-ddec-40f3-b67f-9d9588b194db", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
38422025-08-12T22:48:21.873ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
38432025-08-12T22:48:21.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38442025-08-12T22:48:21.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38452025-08-12T22:48:21.874ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "78ae8ee7-753c-4beb-921d-3c950b812cc0", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
38462025-08-12T22:48:21.874ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
38472025-08-12T22:48:21.875ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
38482025-08-12T22:48:21.875ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38492025-08-12T22:48:21.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38502025-08-12T22:48:21.876ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
38512025-08-12T22:48:21.876ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 833.628025ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
38522025-08-12T22:48:21.888ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
38532025-08-12T22:48:21.888ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
38542025-08-12T22:48:21.888ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38552025-08-12T22:48:21.888ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38562025-08-12T22:48:21.888ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38572025-08-12T22:48:21.888ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38582025-08-12T22:48:21.888ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38592025-08-12T22:48:21.888ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38602025-08-12T22:48:21.888ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38612025-08-12T22:48:21.888ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38622025-08-12T22:48:21.889ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
38632025-08-12T22:48:21.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38642025-08-12T22:48:21.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38652025-08-12T22:48:21.892ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
38662025-08-12T22:48:21.892ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38672025-08-12T22:48:21.994ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0c6c9986-366e-4da8-88ee-d9cde95089c8", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} })
38682025-08-12T22:48:21.994ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
38692025-08-12T22:48:21.994ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38702025-08-12T22:48:21.994ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d5a5ac0-68f8-472e-909c-a09335e1a611", "content-length": "682", "date": "Tue, 12 Aug 2025 22:48:21 GMT"} })
38712025-08-12T22:48:21.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38722025-08-12T22:48:21.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38732025-08-12T22:48:21.998ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38742025-08-12T22:48:21.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38752025-08-12T22:48:22.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38762025-08-12T22:48:22.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38772025-08-12T22:48:22.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38782025-08-12T22:48:22.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38792025-08-12T22:48:22.011ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 967.577979ms iteration = 11 status = {}
38802025-08-12T22:48:22.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 16e103ac-00dc-4418-93ba-a70e0cc6d6e8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
38812025-08-12T22:48:22.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 16e103ac-00dc-4418-93ba-a70e0cc6d6e8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
38822025-08-12T22:48:22.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 16e103ac-00dc-4418-93ba-a70e0cc6d6e8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
38832025-08-12T22:48:23.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 803fb6ff-1181-4851-ba9f-1d81fdc510be roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
38842025-08-12T22:48:23.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 803fb6ff-1181-4851-ba9f-1d81fdc510be resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
38852025-08-12T22:48:23.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 803fb6ff-1181-4851-ba9f-1d81fdc510be response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
38862025-08-12T22:48:24.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 717bafc1-0dca-44fd-9eb9-981de1c52c9b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
38872025-08-12T22:48:24.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 717bafc1-0dca-44fd-9eb9-981de1c52c9b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
38882025-08-12T22:48:24.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 717bafc1-0dca-44fd-9eb9-981de1c52c9b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
38892025-08-12T22:48:25.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e719305c-08e4-4f4d-bb93-03d5fcc3554f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
38902025-08-12T22:48:25.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e719305c-08e4-4f4d-bb93-03d5fcc3554f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
38912025-08-12T22:48:25.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e719305c-08e4-4f4d-bb93-03d5fcc3554f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
38922025-08-12T22:48:26.044ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 62 reason = Timeout
38932025-08-12T22:48:26.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
38942025-08-12T22:48:26.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
38952025-08-12T22:48:26.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38962025-08-12T22:48:26.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
38972025-08-12T22:48:26.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
38982025-08-12T22:48:26.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
38992025-08-12T22:48:26.051ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
39002025-08-12T22:48:26.051ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.487733ms iteration = 62 status = {"chicken_switches_updated":false}
39012025-08-12T22:48:26.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 212911fd-6c00-4b5f-b773-97424993aa2c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39022025-08-12T22:48:26.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 212911fd-6c00-4b5f-b773-97424993aa2c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39032025-08-12T22:48:26.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 212911fd-6c00-4b5f-b773-97424993aa2c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39042025-08-12T22:48:27.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 461dfd25-a929-41bf-a551-8d24226c01ec roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39052025-08-12T22:48:27.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 461dfd25-a929-41bf-a551-8d24226c01ec resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39062025-08-12T22:48:27.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 461dfd25-a929-41bf-a551-8d24226c01ec response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39072025-08-12T22:48:28.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 233703e4-f66b-4ef4-b34c-6923bdb4b895 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39082025-08-12T22:48:28.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 233703e4-f66b-4ef4-b34c-6923bdb4b895 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39092025-08-12T22:48:28.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 233703e4-f66b-4ef4-b34c-6923bdb4b895 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39102025-08-12T22:48:28.831ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 546 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 71b8aabd-9338-4f7e-a464-e90c4a90de6b response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
39112025-08-12T22:48:29.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d29818bb-5773-40fe-aad8-a063937b9825 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39122025-08-12T22:48:29.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d29818bb-5773-40fe-aad8-a063937b9825 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39132025-08-12T22:48:29.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d29818bb-5773-40fe-aad8-a063937b9825 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39142025-08-12T22:48:30.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5fcc7a8b-1e97-49f0-8b2e-9caad2a76ea6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39152025-08-12T22:48:30.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5fcc7a8b-1e97-49f0-8b2e-9caad2a76ea6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39162025-08-12T22:48:30.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5fcc7a8b-1e97-49f0-8b2e-9caad2a76ea6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39172025-08-12T22:48:31.044ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
39182025-08-12T22:48:31.044ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
39192025-08-12T22:48:31.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39202025-08-12T22:48:31.044ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39212025-08-12T22:48:31.044ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 63 reason = Timeout
39222025-08-12T22:48:31.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
39232025-08-12T22:48:31.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
39242025-08-12T22:48:31.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39252025-08-12T22:48:31.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39262025-08-12T22:48:31.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39272025-08-12T22:48:31.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39282025-08-12T22:48:31.046ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39292025-08-12T22:48:31.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39302025-08-12T22:48:31.048ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.539465ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39312025-08-12T22:48:31.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
39322025-08-12T22:48:31.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
39332025-08-12T22:48:31.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
39342025-08-12T22:48:31.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39352025-08-12T22:48:31.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39362025-08-12T22:48:31.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39372025-08-12T22:48:31.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39382025-08-12T22:48:31.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39392025-08-12T22:48:31.051ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
39402025-08-12T22:48:31.051ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.668096ms iteration = 63 status = {"chicken_switches_updated":false}
39412025-08-12T22:48:31.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39422025-08-12T22:48:31.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
39432025-08-12T22:48:31.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39442025-08-12T22:48:31.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39452025-08-12T22:48:31.068ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
39462025-08-12T22:48:31.068ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.294748ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
39472025-08-12T22:48:31.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b4e1d637-d52b-4500-b900-54f98aa8f7c6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39482025-08-12T22:48:31.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b4e1d637-d52b-4500-b900-54f98aa8f7c6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39492025-08-12T22:48:31.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b4e1d637-d52b-4500-b900-54f98aa8f7c6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39502025-08-12T22:48:32.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = afcf4584-7437-49f2-8795-dbcfbafbde66 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39512025-08-12T22:48:32.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = afcf4584-7437-49f2-8795-dbcfbafbde66 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39522025-08-12T22:48:32.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = afcf4584-7437-49f2-8795-dbcfbafbde66 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39532025-08-12T22:48:33.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a96599cf-832d-43c5-94b1-595156ddfae8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39542025-08-12T22:48:33.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a96599cf-832d-43c5-94b1-595156ddfae8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39552025-08-12T22:48:33.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a96599cf-832d-43c5-94b1-595156ddfae8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39562025-08-12T22:48:34.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7c68a82a-820c-4df5-98dc-b5e9109563e4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39572025-08-12T22:48:34.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7c68a82a-820c-4df5-98dc-b5e9109563e4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39582025-08-12T22:48:34.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7c68a82a-820c-4df5-98dc-b5e9109563e4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39592025-08-12T22:48:35.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 14ab2682-ca25-4bff-ab0f-ab67bd9b67fe roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39602025-08-12T22:48:35.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 14ab2682-ca25-4bff-ab0f-ab67bd9b67fe resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39612025-08-12T22:48:35.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 14ab2682-ca25-4bff-ab0f-ab67bd9b67fe response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39622025-08-12T22:48:36.043ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 64 reason = Timeout
39632025-08-12T22:48:36.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
39642025-08-12T22:48:36.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
39652025-08-12T22:48:36.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39662025-08-12T22:48:36.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
39672025-08-12T22:48:36.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
39682025-08-12T22:48:36.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
39692025-08-12T22:48:36.050ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
39702025-08-12T22:48:36.050ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.904378ms iteration = 64 status = {"chicken_switches_updated":false}
39712025-08-12T22:48:36.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 983471ce-868c-48ec-84ad-8caeda5de789 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39722025-08-12T22:48:36.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 983471ce-868c-48ec-84ad-8caeda5de789 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39732025-08-12T22:48:36.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 983471ce-868c-48ec-84ad-8caeda5de789 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39742025-08-12T22:48:37.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e6fd1d0c-6d17-48dc-9cc4-ee990269cd8f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39752025-08-12T22:48:37.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e6fd1d0c-6d17-48dc-9cc4-ee990269cd8f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39762025-08-12T22:48:37.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e6fd1d0c-6d17-48dc-9cc4-ee990269cd8f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39772025-08-12T22:48:38.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 30f0fff1-8a8d-49c3-a050-6ef036ddcde5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39782025-08-12T22:48:38.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 30f0fff1-8a8d-49c3-a050-6ef036ddcde5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39792025-08-12T22:48:38.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 30f0fff1-8a8d-49c3-a050-6ef036ddcde5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39802025-08-12T22:48:38.832ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 747 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 70d79c97-a11f-4552-a497-e6d186d88a3a response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
39812025-08-12T22:48:39.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 801a720c-2b2b-4a33-9124-af8fbe550e90 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39822025-08-12T22:48:39.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 801a720c-2b2b-4a33-9124-af8fbe550e90 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39832025-08-12T22:48:39.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 801a720c-2b2b-4a33-9124-af8fbe550e90 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39842025-08-12T22:48:40.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 59aa0944-06f7-44cb-82b5-85682487ee9a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39852025-08-12T22:48:40.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 59aa0944-06f7-44cb-82b5-85682487ee9a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39862025-08-12T22:48:40.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 59aa0944-06f7-44cb-82b5-85682487ee9a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
39872025-08-12T22:48:41.043ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
39882025-08-12T22:48:41.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39892025-08-12T22:48:41.043ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
39902025-08-12T22:48:41.043ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 65 reason = Timeout
39912025-08-12T22:48:41.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39922025-08-12T22:48:41.043ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
39932025-08-12T22:48:41.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39942025-08-12T22:48:41.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39952025-08-12T22:48:41.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
39962025-08-12T22:48:41.046ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39972025-08-12T22:48:41.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39982025-08-12T22:48:41.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39992025-08-12T22:48:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40002025-08-12T22:48:41.048ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.690096ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40012025-08-12T22:48:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40022025-08-12T22:48:41.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40032025-08-12T22:48:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40042025-08-12T22:48:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
40052025-08-12T22:48:41.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
40062025-08-12T22:48:41.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
40072025-08-12T22:48:41.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40082025-08-12T22:48:41.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40092025-08-12T22:48:41.051ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
40102025-08-12T22:48:41.051ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.090259ms iteration = 65 status = {"chicken_switches_updated":false}
40112025-08-12T22:48:41.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40122025-08-12T22:48:41.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
40132025-08-12T22:48:41.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40142025-08-12T22:48:41.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40152025-08-12T22:48:41.069ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
40162025-08-12T22:48:41.069ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.995915ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
40172025-08-12T22:48:41.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4ea0f66d-668a-4088-be6d-185d4e8139a3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40182025-08-12T22:48:41.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4ea0f66d-668a-4088-be6d-185d4e8139a3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40192025-08-12T22:48:41.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4ea0f66d-668a-4088-be6d-185d4e8139a3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40202025-08-12T22:48:42.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4a6e34ab-ef02-45ac-b313-d952dad4110c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40212025-08-12T22:48:42.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4a6e34ab-ef02-45ac-b313-d952dad4110c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40222025-08-12T22:48:42.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4a6e34ab-ef02-45ac-b313-d952dad4110c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40232025-08-12T22:48:43.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9fa9e181-ee7e-40f0-aa90-c8c678bd7c67 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40242025-08-12T22:48:43.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9fa9e181-ee7e-40f0-aa90-c8c678bd7c67 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40252025-08-12T22:48:43.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9fa9e181-ee7e-40f0-aa90-c8c678bd7c67 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40262025-08-12T22:48:44.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a57a47b5-527d-42a4-bbd8-311b216a76d0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40272025-08-12T22:48:44.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a57a47b5-527d-42a4-bbd8-311b216a76d0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40282025-08-12T22:48:44.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a57a47b5-527d-42a4-bbd8-311b216a76d0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40292025-08-12T22:48:45.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 00efcee8-4050-47b4-bfc2-32934737157d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40302025-08-12T22:48:45.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 00efcee8-4050-47b4-bfc2-32934737157d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40312025-08-12T22:48:45.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 00efcee8-4050-47b4-bfc2-32934737157d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40322025-08-12T22:48:46.044ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 66 reason = Timeout
40332025-08-12T22:48:46.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
40342025-08-12T22:48:46.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
40352025-08-12T22:48:46.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40362025-08-12T22:48:46.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
40372025-08-12T22:48:46.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
40382025-08-12T22:48:46.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
40392025-08-12T22:48:46.051ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
40402025-08-12T22:48:46.051ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.389703ms iteration = 66 status = {"chicken_switches_updated":false}
40412025-08-12T22:48:46.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 86eb459e-1f28-41ac-973e-65cc993dc4fb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40422025-08-12T22:48:46.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 86eb459e-1f28-41ac-973e-65cc993dc4fb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40432025-08-12T22:48:46.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 86eb459e-1f28-41ac-973e-65cc993dc4fb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40442025-08-12T22:48:47.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d0125613-0096-4582-9dcc-76305e143a15 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40452025-08-12T22:48:47.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d0125613-0096-4582-9dcc-76305e143a15 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40462025-08-12T22:48:47.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d0125613-0096-4582-9dcc-76305e143a15 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40472025-08-12T22:48:48.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e377835-d380-4b85-b77b-aba860c693eb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40482025-08-12T22:48:48.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e377835-d380-4b85-b77b-aba860c693eb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40492025-08-12T22:48:48.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e377835-d380-4b85-b77b-aba860c693eb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40502025-08-12T22:48:48.832ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 991 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = a45f96ca-1e0e-4a12-9d35-3482ea3f96ff response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
40512025-08-12T22:48:49.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be9fdcd7-f7eb-445f-aba5-5e66c24c5e45 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40522025-08-12T22:48:49.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be9fdcd7-f7eb-445f-aba5-5e66c24c5e45 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40532025-08-12T22:48:49.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be9fdcd7-f7eb-445f-aba5-5e66c24c5e45 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40542025-08-12T22:48:50.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e110c0a5-d8ac-4fbf-904d-27b058fb1215 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40552025-08-12T22:48:50.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e110c0a5-d8ac-4fbf-904d-27b058fb1215 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40562025-08-12T22:48:50.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e110c0a5-d8ac-4fbf-904d-27b058fb1215 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
40572025-08-12T22:48:51.043ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
40582025-08-12T22:48:51.043ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
40592025-08-12T22:48:51.043ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40602025-08-12T22:48:51.043ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
40612025-08-12T22:48:51.043ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40622025-08-12T22:48:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40632025-08-12T22:48:51.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40642025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 12 reason = Timeout
40652025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
40662025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 14.769\u{b5}s iteration = 12 status = {"disabled":true,"errors":[],"sps":[]}
40672025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
40682025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40692025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
40702025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40712025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40722025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
40732025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40742025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
40752025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40762025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
40772025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
40782025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40792025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
40802025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40812025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40822025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
40832025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40842025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
40852025-08-12T22:48:51.044ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40862025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40872025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 12 reason = Timeout
40882025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
40892025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
40902025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40912025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
40922025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 67 reason = Timeout
40932025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40942025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
40952025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
40962025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40972025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40982025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
40992025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41002025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
41012025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41022025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41032025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41042025-08-12T22:48:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41052025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41062025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41072025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41082025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41092025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41102025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
41112025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41122025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
41132025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41142025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41152025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41162025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41172025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41182025-08-12T22:48:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41192025-08-12T22:48:51.046ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1333, tv_nsec: 284185320 } })
41202025-08-12T22:48:51.046ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1333, tv_nsec: 284481643 } })
41212025-08-12T22:48:51.046ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
41222025-08-12T22:48:51.047ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41232025-08-12T22:48:51.047ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
41242025-08-12T22:48:51.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.455434ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
41252025-08-12T22:48:51.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41262025-08-12T22:48:51.047ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41272025-08-12T22:48:51.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41282025-08-12T22:48:51.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41292025-08-12T22:48:51.047ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.0561ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41302025-08-12T22:48:51.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41312025-08-12T22:48:51.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41322025-08-12T22:48:51.048ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.449794ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
41332025-08-12T22:48:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41342025-08-12T22:48:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41352025-08-12T22:48:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41362025-08-12T22:48:51.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.07672ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41372025-08-12T22:48:51.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.838818ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41382025-08-12T22:48:51.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41392025-08-12T22:48:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
41402025-08-12T22:48:51.050ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41412025-08-12T22:48:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41422025-08-12T22:48:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41432025-08-12T22:48:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41442025-08-12T22:48:51.051ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41452025-08-12T22:48:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41462025-08-12T22:48:51.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41472025-08-12T22:48:51.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41482025-08-12T22:48:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41492025-08-12T22:48:51.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41502025-08-12T22:48:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41512025-08-12T22:48:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41522025-08-12T22:48:51.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41532025-08-12T22:48:51.052ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 7.770366ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41542025-08-12T22:48:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41552025-08-12T22:48:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41562025-08-12T22:48:51.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41572025-08-12T22:48:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
41582025-08-12T22:48:51.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
41592025-08-12T22:48:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41602025-08-12T22:48:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
41612025-08-12T22:48:51.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41622025-08-12T22:48:51.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41632025-08-12T22:48:51.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41642025-08-12T22:48:51.054ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
41652025-08-12T22:48:51.054ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 9.830566ms iteration = 67 status = {"chicken_switches_updated":false}
41662025-08-12T22:48:51.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41672025-08-12T22:48:51.055ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1333, tv_nsec: 292836605 } })
41682025-08-12T22:48:51.055ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
41692025-08-12T22:48:51.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41702025-08-12T22:48:51.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41712025-08-12T22:48:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41722025-08-12T22:48:51.057ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41732025-08-12T22:48:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41742025-08-12T22:48:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41752025-08-12T22:48:51.065ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 20.38495ms iteration = 14 status = {"physical_disks_added":0}
41762025-08-12T22:48:51.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41772025-08-12T22:48:51.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41782025-08-12T22:48:51.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41792025-08-12T22:48:51.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41802025-08-12T22:48:51.100ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41812025-08-12T22:48:51.100ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
41822025-08-12T22:48:51.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41832025-08-12T22:48:51.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41842025-08-12T22:48:51.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41852025-08-12T22:48:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41862025-08-12T22:48:51.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41872025-08-12T22:48:51.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41882025-08-12T22:48:51.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41892025-08-12T22:48:51.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41902025-08-12T22:48:51.103ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41912025-08-12T22:48:51.103ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41922025-08-12T22:48:51.103ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41932025-08-12T22:48:51.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41942025-08-12T22:48:51.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41952025-08-12T22:48:51.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41962025-08-12T22:48:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41972025-08-12T22:48:51.104ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41982025-08-12T22:48:51.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41992025-08-12T22:48:51.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42002025-08-12T22:48:51.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42012025-08-12T22:48:51.106ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 61.921507ms iteration = 12 status = {"errors":[],"requests_created_ok":[]}
42022025-08-12T22:48:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
42032025-08-12T22:48:51.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42042025-08-12T22:48:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42052025-08-12T22:48:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42062025-08-12T22:48:51.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42072025-08-12T22:48:51.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42082025-08-12T22:48:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
42092025-08-12T22:48:51.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42102025-08-12T22:48:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42112025-08-12T22:48:51.111ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 66.472682ms iteration = 12 status = 0
42122025-08-12T22:48:51.117ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42132025-08-12T22:48:51.117ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.293009ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42142025-08-12T22:48:51.127ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
42152025-08-12T22:48:51.127ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.549199ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
42162025-08-12T22:48:51.145ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42172025-08-12T22:48:51.145ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
42182025-08-12T22:48:51.145ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42192025-08-12T22:48:51.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42202025-08-12T22:48:51.146ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "faaf35db-4821-4296-be78-399dc36902b8", "content-length": "26", "date": "Tue, 12 Aug 2025 22:48:51 GMT"} })
42212025-08-12T22:48:51.146ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42222025-08-12T22:48:51.146ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42232025-08-12T22:48:51.146ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
42242025-08-12T22:48:51.146ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.644287ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
42252025-08-12T22:48:51.147ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 102.664667ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
42262025-08-12T22:48:51.147ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42272025-08-12T22:48:51.150ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42282025-08-12T22:48:51.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
42292025-08-12T22:48:51.152ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42302025-08-12T22:48:51.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42312025-08-12T22:48:51.154ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
42322025-08-12T22:48:51.154ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 110.254371ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
42332025-08-12T22:48:51.172ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
42342025-08-12T22:48:51.172ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42352025-08-12T22:48:51.172ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd439f39-c978-497c-b188-432ce068d4ae", "content-length": "26", "date": "Tue, 12 Aug 2025 22:48:51 GMT"} })
42362025-08-12T22:48:51.172ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42372025-08-12T22:48:51.173ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
42382025-08-12T22:48:51.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42392025-08-12T22:48:51.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42402025-08-12T22:48:51.193ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42412025-08-12T22:48:51.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42422025-08-12T22:48:51.195ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42432025-08-12T22:48:51.197ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42442025-08-12T22:48:51.197ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42452025-08-12T22:48:51.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42462025-08-12T22:48:51.198ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42472025-08-12T22:48:51.200ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42482025-08-12T22:48:51.200ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42492025-08-12T22:48:51.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42502025-08-12T22:48:51.241ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
42512025-08-12T22:48:51.241ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42522025-08-12T22:48:51.241ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97e0cf4c-df3e-40eb-bb83-3c9f1e8503f7", "content-length": "26", "date": "Tue, 12 Aug 2025 22:48:51 GMT"} })
42532025-08-12T22:48:51.241ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42542025-08-12T22:48:51.243ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42552025-08-12T22:48:51.270ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 226.892845ms iteration = 12 status = {}
42562025-08-12T22:48:51.274ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42572025-08-12T22:48:51.274ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42582025-08-12T22:48:51.274ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "05b02272-8fd2-4fc0-be02-e060ced9e6a6", "content-length": "372", "date": "Tue, 12 Aug 2025 22:48:51 GMT"} })
42592025-08-12T22:48:51.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42602025-08-12T22:48:51.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42612025-08-12T22:48:51.289ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
42622025-08-12T22:48:51.289ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42632025-08-12T22:48:51.289ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "17704ba1-24cb-4eb6-9389-d0ef49079410", "date": "Tue, 12 Aug 2025 22:48:51 GMT"} })
42642025-08-12T22:48:51.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42652025-08-12T22:48:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42662025-08-12T22:48:51.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42672025-08-12T22:48:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42682025-08-12T22:48:51.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42692025-08-12T22:48:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42702025-08-12T22:48:51.298ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42712025-08-12T22:48:51.298ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42722025-08-12T22:48:51.299ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "db7f57a8-3021-465f-87df-4cc1ef30147a", "date": "Tue, 12 Aug 2025 22:48:51 GMT"} })
42732025-08-12T22:48:51.300ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 255.92035ms iteration = 12 status = {}
42742025-08-12T22:48:51.311ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42752025-08-12T22:48:51.311ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c457f5d-9bfe-43bd-a23e-bbb11d05e8b5", "content-length": "691", "date": "Tue, 12 Aug 2025 22:48:51 GMT"} })
42762025-08-12T22:48:51.311ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
42772025-08-12T22:48:51.311ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
42782025-08-12T22:48:51.311ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
42792025-08-12T22:48:51.313ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 269.025598ms iteration = 12 status = {}
42802025-08-12T22:48:51.334ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42812025-08-12T22:48:51.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42822025-08-12T22:48:51.336ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 293.067014ms iteration = 12 status = null
42832025-08-12T22:48:51.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42842025-08-12T22:48:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42852025-08-12T22:48:51.394ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
42862025-08-12T22:48:51.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42872025-08-12T22:48:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42882025-08-12T22:48:51.422ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
42892025-08-12T22:48:51.422ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
42902025-08-12T22:48:51.422ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42912025-08-12T22:48:51.422ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42922025-08-12T22:48:51.422ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42932025-08-12T22:48:51.422ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42942025-08-12T22:48:51.422ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42952025-08-12T22:48:51.422ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42962025-08-12T22:48:51.422ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42972025-08-12T22:48:51.422ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42982025-08-12T22:48:51.423ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
42992025-08-12T22:48:51.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43002025-08-12T22:48:51.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43012025-08-12T22:48:51.426ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
43022025-08-12T22:48:51.426ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
43032025-08-12T22:48:51.545ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "78c62932-3bd6-441b-9ad0-7942fb458f97", "date": "Tue, 12 Aug 2025 22:48:51 GMT"} })
43042025-08-12T22:48:51.545ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
43052025-08-12T22:48:51.545ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43062025-08-12T22:48:51.545ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f0e658a-f558-4e34-a086-90fca0fae72f", "content-length": "682", "date": "Tue, 12 Aug 2025 22:48:51 GMT"} })
43072025-08-12T22:48:51.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43082025-08-12T22:48:51.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43092025-08-12T22:48:51.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43102025-08-12T22:48:51.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43112025-08-12T22:48:51.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43122025-08-12T22:48:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43132025-08-12T22:48:51.556ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43142025-08-12T22:48:51.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43152025-08-12T22:48:51.563ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 518.753008ms iteration = 12 status = {}
43162025-08-12T22:48:51.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc20814a-a3b5-41cb-963b-81d114247bf5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43172025-08-12T22:48:51.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc20814a-a3b5-41cb-963b-81d114247bf5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43182025-08-12T22:48:51.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc20814a-a3b5-41cb-963b-81d114247bf5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43192025-08-12T22:48:52.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a60d46fc-b642-4737-bd92-4e5258a235bb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43202025-08-12T22:48:52.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a60d46fc-b642-4737-bd92-4e5258a235bb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43212025-08-12T22:48:52.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a60d46fc-b642-4737-bd92-4e5258a235bb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43222025-08-12T22:48:53.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 26234524-734e-42b0-a950-c6fa0418d47a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43232025-08-12T22:48:53.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 26234524-734e-42b0-a950-c6fa0418d47a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43242025-08-12T22:48:53.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 26234524-734e-42b0-a950-c6fa0418d47a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43252025-08-12T22:48:54.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 24ffacb5-de62-4e09-893e-c9b26624c3ec roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43262025-08-12T22:48:54.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 24ffacb5-de62-4e09-893e-c9b26624c3ec resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43272025-08-12T22:48:54.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 24ffacb5-de62-4e09-893e-c9b26624c3ec response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43282025-08-12T22:48:55.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 449346f3-8c76-4e6c-9b90-b5028134244d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43292025-08-12T22:48:55.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 449346f3-8c76-4e6c-9b90-b5028134244d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43302025-08-12T22:48:55.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 449346f3-8c76-4e6c-9b90-b5028134244d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43312025-08-12T22:48:56.044ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 68 reason = Timeout
43322025-08-12T22:48:56.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
43332025-08-12T22:48:56.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
43342025-08-12T22:48:56.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43352025-08-12T22:48:56.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
43362025-08-12T22:48:56.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
43372025-08-12T22:48:56.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
43382025-08-12T22:48:56.051ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
43392025-08-12T22:48:56.051ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.936799ms iteration = 68 status = {"chicken_switches_updated":false}
43402025-08-12T22:48:56.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 22ae0b43-6eb9-44e3-ba38-7692e0bbd2a5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43412025-08-12T22:48:56.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 22ae0b43-6eb9-44e3-ba38-7692e0bbd2a5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43422025-08-12T22:48:56.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 22ae0b43-6eb9-44e3-ba38-7692e0bbd2a5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43432025-08-12T22:48:57.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6111883d-4964-4c73-96bb-fe5e91e10d99 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43442025-08-12T22:48:57.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6111883d-4964-4c73-96bb-fe5e91e10d99 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43452025-08-12T22:48:57.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6111883d-4964-4c73-96bb-fe5e91e10d99 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43462025-08-12T22:48:58.832ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 578 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 359f839c-f040-45b0-8589-6a0773b5f16e response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
43472025-08-12T22:48:58.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f771f857-3bba-46ff-aafc-f5626f115543 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43482025-08-12T22:48:58.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f771f857-3bba-46ff-aafc-f5626f115543 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43492025-08-12T22:48:58.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f771f857-3bba-46ff-aafc-f5626f115543 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43502025-08-12T22:48:59.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0da0f4bc-aeee-41f6-a4f4-959537a05068 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43512025-08-12T22:48:59.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0da0f4bc-aeee-41f6-a4f4-959537a05068 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43522025-08-12T22:48:59.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0da0f4bc-aeee-41f6-a4f4-959537a05068 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43532025-08-12T22:49:00.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9817656b-4404-4198-a48b-af6d995aa54e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43542025-08-12T22:49:00.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9817656b-4404-4198-a48b-af6d995aa54e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43552025-08-12T22:49:00.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9817656b-4404-4198-a48b-af6d995aa54e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43562025-08-12T22:49:01.044ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
43572025-08-12T22:49:01.044ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
43582025-08-12T22:49:01.044ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43592025-08-12T22:49:01.044ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 69 reason = Timeout
43602025-08-12T22:49:01.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43612025-08-12T22:49:01.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
43622025-08-12T22:49:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43632025-08-12T22:49:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43642025-08-12T22:49:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
43652025-08-12T22:49:01.046ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43662025-08-12T22:49:01.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43672025-08-12T22:49:01.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43682025-08-12T22:49:01.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43692025-08-12T22:49:01.048ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.804278ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43702025-08-12T22:49:01.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
43712025-08-12T22:49:01.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
43722025-08-12T22:49:01.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
43732025-08-12T22:49:01.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43742025-08-12T22:49:01.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43752025-08-12T22:49:01.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43762025-08-12T22:49:01.052ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
43772025-08-12T22:49:01.052ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.694565ms iteration = 69 status = {"chicken_switches_updated":false}
43782025-08-12T22:49:01.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43792025-08-12T22:49:01.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43802025-08-12T22:49:01.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43812025-08-12T22:49:01.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
43822025-08-12T22:49:01.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43832025-08-12T22:49:01.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43842025-08-12T22:49:01.069ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
43852025-08-12T22:49:01.069ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.967814ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
43862025-08-12T22:49:01.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6fe98faf-aba9-4969-bbce-908963308fde roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43872025-08-12T22:49:01.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6fe98faf-aba9-4969-bbce-908963308fde resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43882025-08-12T22:49:01.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6fe98faf-aba9-4969-bbce-908963308fde response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43892025-08-12T22:49:02.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ee8080df-da7e-438d-906c-7dfb77d211c3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43902025-08-12T22:49:02.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ee8080df-da7e-438d-906c-7dfb77d211c3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43912025-08-12T22:49:02.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ee8080df-da7e-438d-906c-7dfb77d211c3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43922025-08-12T22:49:03.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e1590b80-6ab2-4ef0-82a6-6019b8110c39 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43932025-08-12T22:49:03.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e1590b80-6ab2-4ef0-82a6-6019b8110c39 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43942025-08-12T22:49:03.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e1590b80-6ab2-4ef0-82a6-6019b8110c39 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43952025-08-12T22:49:04.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7acf87c9-a5cd-49ed-ba55-9576786845ef roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43962025-08-12T22:49:04.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7acf87c9-a5cd-49ed-ba55-9576786845ef resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43972025-08-12T22:49:04.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7acf87c9-a5cd-49ed-ba55-9576786845ef response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43982025-08-12T22:49:05.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 77b86fd7-88a0-4d83-88e4-e90b1c93205a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
43992025-08-12T22:49:05.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 77b86fd7-88a0-4d83-88e4-e90b1c93205a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44002025-08-12T22:49:05.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 77b86fd7-88a0-4d83-88e4-e90b1c93205a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44012025-08-12T22:49:06.044ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 70 reason = Timeout
44022025-08-12T22:49:06.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44032025-08-12T22:49:06.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44042025-08-12T22:49:06.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44052025-08-12T22:49:06.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
44062025-08-12T22:49:06.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44072025-08-12T22:49:06.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44082025-08-12T22:49:06.051ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
44092025-08-12T22:49:06.051ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.018549ms iteration = 70 status = {"chicken_switches_updated":false}
44102025-08-12T22:49:07.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cded2f76-6e6e-449b-bdf3-d2840f58e339 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44112025-08-12T22:49:07.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cded2f76-6e6e-449b-bdf3-d2840f58e339 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44122025-08-12T22:49:07.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cded2f76-6e6e-449b-bdf3-d2840f58e339 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44132025-08-12T22:49:08.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b2eaffcd-ef50-422d-ac6d-b887c5ee8aa9 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44142025-08-12T22:49:08.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b2eaffcd-ef50-422d-ac6d-b887c5ee8aa9 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44152025-08-12T22:49:08.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b2eaffcd-ef50-422d-ac6d-b887c5ee8aa9 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44162025-08-12T22:49:08.832ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 788 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 1d6bd66f-fbf2-4067-b574-23f778028490 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
44172025-08-12T22:49:09.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7c39f88e-873b-4b8e-a9e3-2cd732c3797c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44182025-08-12T22:49:09.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7c39f88e-873b-4b8e-a9e3-2cd732c3797c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44192025-08-12T22:49:09.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7c39f88e-873b-4b8e-a9e3-2cd732c3797c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44202025-08-12T22:49:10.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 68b9b565-3aa3-49e0-89de-c014b87e1631 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44212025-08-12T22:49:10.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 68b9b565-3aa3-49e0-89de-c014b87e1631 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44222025-08-12T22:49:10.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 68b9b565-3aa3-49e0-89de-c014b87e1631 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44232025-08-12T22:49:11.044ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
44242025-08-12T22:49:11.044ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44252025-08-12T22:49:11.044ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
44262025-08-12T22:49:11.044ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 71 reason = Timeout
44272025-08-12T22:49:11.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44282025-08-12T22:49:11.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44292025-08-12T22:49:11.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44302025-08-12T22:49:11.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44312025-08-12T22:49:11.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44322025-08-12T22:49:11.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44332025-08-12T22:49:11.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44342025-08-12T22:49:11.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44352025-08-12T22:49:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44362025-08-12T22:49:11.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.499664ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44372025-08-12T22:49:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44382025-08-12T22:49:11.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44392025-08-12T22:49:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
44402025-08-12T22:49:11.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44412025-08-12T22:49:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44422025-08-12T22:49:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44432025-08-12T22:49:11.052ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
44442025-08-12T22:49:11.052ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.020688ms iteration = 71 status = {"chicken_switches_updated":false}
44452025-08-12T22:49:11.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44462025-08-12T22:49:11.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44472025-08-12T22:49:11.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44482025-08-12T22:49:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
44492025-08-12T22:49:11.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44502025-08-12T22:49:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44512025-08-12T22:49:11.069ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
44522025-08-12T22:49:11.069ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.46798ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
44532025-08-12T22:49:11.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = caa0d118-edde-43a8-82e5-95c081297e76 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44542025-08-12T22:49:11.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = caa0d118-edde-43a8-82e5-95c081297e76 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44552025-08-12T22:49:11.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = caa0d118-edde-43a8-82e5-95c081297e76 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44562025-08-12T22:49:12.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6dced7ee-49d4-4751-a0d9-4b7e65518dcc roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44572025-08-12T22:49:12.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6dced7ee-49d4-4751-a0d9-4b7e65518dcc resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44582025-08-12T22:49:12.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6dced7ee-49d4-4751-a0d9-4b7e65518dcc response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44592025-08-12T22:49:13.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5c68e65b-3729-4d96-936e-d7addfe30178 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44602025-08-12T22:49:13.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5c68e65b-3729-4d96-936e-d7addfe30178 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44612025-08-12T22:49:13.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5c68e65b-3729-4d96-936e-d7addfe30178 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44622025-08-12T22:49:14.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 114ff18a-16de-4f3c-99cc-f857aae85c3c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44632025-08-12T22:49:14.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 114ff18a-16de-4f3c-99cc-f857aae85c3c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44642025-08-12T22:49:14.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 114ff18a-16de-4f3c-99cc-f857aae85c3c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44652025-08-12T22:49:15.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 39d5034a-358f-4739-964e-ac227b64aff5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44662025-08-12T22:49:15.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 39d5034a-358f-4739-964e-ac227b64aff5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44672025-08-12T22:49:15.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 39d5034a-358f-4739-964e-ac227b64aff5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44682025-08-12T22:49:16.044ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 72 reason = Timeout
44692025-08-12T22:49:16.044ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44702025-08-12T22:49:16.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44712025-08-12T22:49:16.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44722025-08-12T22:49:16.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
44732025-08-12T22:49:16.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
44742025-08-12T22:49:16.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
44752025-08-12T22:49:16.050ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
44762025-08-12T22:49:16.051ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.346712ms iteration = 72 status = {"chicken_switches_updated":false}
44772025-08-12T22:49:16.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f8bb9d58-7ee7-4e95-8a67-6cd00891453a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44782025-08-12T22:49:16.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f8bb9d58-7ee7-4e95-8a67-6cd00891453a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44792025-08-12T22:49:16.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f8bb9d58-7ee7-4e95-8a67-6cd00891453a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44802025-08-12T22:49:17.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c839fa95-0bf6-4a5b-b8bf-89baa9e85cf4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44812025-08-12T22:49:17.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c839fa95-0bf6-4a5b-b8bf-89baa9e85cf4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44822025-08-12T22:49:17.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c839fa95-0bf6-4a5b-b8bf-89baa9e85cf4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44832025-08-12T22:49:18.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d323ab98-7005-469e-a9eb-4298c84322f0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44842025-08-12T22:49:18.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d323ab98-7005-469e-a9eb-4298c84322f0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44852025-08-12T22:49:18.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d323ab98-7005-469e-a9eb-4298c84322f0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44862025-08-12T22:49:18.833ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 592 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 0fb69650-9976-4f10-b5d4-ae8b994ebdee response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
44872025-08-12T22:49:19.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 530de2dd-e6c5-437f-b2c4-0f6e43a0135e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44882025-08-12T22:49:19.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 530de2dd-e6c5-437f-b2c4-0f6e43a0135e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44892025-08-12T22:49:19.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 530de2dd-e6c5-437f-b2c4-0f6e43a0135e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44902025-08-12T22:49:20.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 84de8213-2202-4231-a420-558caef2d127 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44912025-08-12T22:49:20.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 84de8213-2202-4231-a420-558caef2d127 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44922025-08-12T22:49:20.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 84de8213-2202-4231-a420-558caef2d127 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
44932025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
44942025-08-12T22:49:21.044ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0
44952025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.51\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0"}
44962025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
44972025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
44982025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
44992025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45002025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45012025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
45022025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
45032025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45042025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
45052025-08-12T22:49:21.044ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-12 22:39:21.044452147 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
45062025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
45072025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
45082025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
45092025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
45102025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
45112025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
45122025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
45132025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45142025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
45152025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45162025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
45172025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
45182025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
45192025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
45202025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
45212025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45222025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45232025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45242025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45252025-08-12T22:49:21.044ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
45262025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
45272025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
45282025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45292025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
45302025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45312025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 13 reason = Timeout
45322025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
45332025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 18.06\u{b5}s iteration = 13 status = {"disabled":true,"errors":[],"sps":[]}
45342025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45352025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45362025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
45372025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
45382025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45392025-08-12T22:49:21.044ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45402025-08-12T22:49:21.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45412025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
45422025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
45432025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45442025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45452025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
45462025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 73 reason = Timeout
45472025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45482025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 13 reason = Timeout
45492025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
45502025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45512025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
45522025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 7 reason = Timeout
45532025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
45542025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45552025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
45562025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45572025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45582025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
45592025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45602025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
45612025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
45622025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
45632025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45642025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
45652025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 7 reason = Timeout
45662025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
45672025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
45682025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
45692025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 10 reason = Timeout
45702025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
45712025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 11.07\u{b5}s iteration = 10 status = "Disabled"
45722025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
45732025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
45742025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
45752025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45762025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45772025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45782025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45792025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45802025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45812025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45822025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
45832025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45842025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45852025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45862025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45872025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45882025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
45892025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45902025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45912025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
45922025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
45932025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45942025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45952025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45962025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
45972025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
45982025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
45992025-08-12T22:49:21.045ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3e3264d-303d-4ce7-a0ce-0090b10b154f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1363, tv_nsec: 282691529 } })
46002025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46012025-08-12T22:49:21.045ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("043b8097-0e38-4228-bada-dac70e518148.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26cd5275-57f5-4466-a94f-f96956f55588.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1363, tv_nsec: 282707579 } })
46022025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
46032025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46042025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46052025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
46062025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
46072025-08-12T22:49:21.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46082025-08-12T22:49:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
46092025-08-12T22:49:21.046ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
46102025-08-12T22:49:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.641066ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
46112025-08-12T22:49:21.046ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
46122025-08-12T22:49:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46132025-08-12T22:49:21.046ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
46142025-08-12T22:49:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.835358ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
46152025-08-12T22:49:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
46162025-08-12T22:49:21.046ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
46172025-08-12T22:49:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
46182025-08-12T22:49:21.047ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1363, tv_nsec: 284080033 } })
46192025-08-12T22:49:21.047ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46202025-08-12T22:49:21.047ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
46212025-08-12T22:49:21.047ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1363, tv_nsec: 284536577 } })
46222025-08-12T22:49:21.047ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46232025-08-12T22:49:21.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46242025-08-12T22:49:21.047ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
46252025-08-12T22:49:21.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46262025-08-12T22:49:21.048ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-12 22:39:21.044452147 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
46272025-08-12T22:49:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.646656ms iteration = 7 status = {"expiration":"2025-08-12T22:39:21.044452147Z","pruned":[]}
46282025-08-12T22:49:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.09142ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46292025-08-12T22:49:21.049ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.573125ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
46302025-08-12T22:49:21.049ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46312025-08-12T22:49:21.049ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46322025-08-12T22:49:21.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46332025-08-12T22:49:21.049ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46342025-08-12T22:49:21.049ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46352025-08-12T22:49:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46362025-08-12T22:49:21.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46372025-08-12T22:49:21.050ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
46382025-08-12T22:49:21.050ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
46392025-08-12T22:49:21.050ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.774786ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
46402025-08-12T22:49:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46412025-08-12T22:49:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46422025-08-12T22:49:21.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46432025-08-12T22:49:21.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46442025-08-12T22:49:21.051ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46452025-08-12T22:49:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.933068ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
46462025-08-12T22:49:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46472025-08-12T22:49:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46482025-08-12T22:49:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
46492025-08-12T22:49:21.052ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46502025-08-12T22:49:21.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46512025-08-12T22:49:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46522025-08-12T22:49:21.053ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
46532025-08-12T22:49:21.053ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 8.21046ms iteration = 7 status = {"by_rx":{},"error":null}
46542025-08-12T22:49:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46552025-08-12T22:49:21.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46562025-08-12T22:49:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46572025-08-12T22:49:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
46582025-08-12T22:49:21.055ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
46592025-08-12T22:49:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
46602025-08-12T22:49:21.055ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46612025-08-12T22:49:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46622025-08-12T22:49:21.056ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46632025-08-12T22:49:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
46642025-08-12T22:49:21.057ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
46652025-08-12T22:49:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
46662025-08-12T22:49:21.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46672025-08-12T22:49:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
46682025-08-12T22:49:21.057ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
46692025-08-12T22:49:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
46702025-08-12T22:49:21.058ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46712025-08-12T22:49:21.058ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46722025-08-12T22:49:21.058ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46732025-08-12T22:49:21.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46742025-08-12T22:49:21.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46752025-08-12T22:49:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46762025-08-12T22:49:21.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46772025-08-12T22:49:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46782025-08-12T22:49:21.059ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 14.819156ms iteration = 13 status = {"errors":[],"requests_created_ok":[]}
46792025-08-12T22:49:21.059ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
46802025-08-12T22:49:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46812025-08-12T22:49:21.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46822025-08-12T22:49:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
46832025-08-12T22:49:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46842025-08-12T22:49:21.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46852025-08-12T22:49:21.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46862025-08-12T22:49:21.060ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46872025-08-12T22:49:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46882025-08-12T22:49:21.060ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46892025-08-12T22:49:21.061ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46902025-08-12T22:49:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46912025-08-12T22:49:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
46922025-08-12T22:49:21.061ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
46932025-08-12T22:49:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46942025-08-12T22:49:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46952025-08-12T22:49:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
46962025-08-12T22:49:21.061ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46972025-08-12T22:49:21.062ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
46982025-08-12T22:49:21.062ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 17.217369ms iteration = 73 status = {"chicken_switches_updated":false}
46992025-08-12T22:49:21.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 17.744794ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47002025-08-12T22:49:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
47012025-08-12T22:49:21.063ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
47022025-08-12T22:49:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47032025-08-12T22:49:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
47042025-08-12T22:49:21.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47052025-08-12T22:49:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47062025-08-12T22:49:21.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47072025-08-12T22:49:21.066ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47082025-08-12T22:49:21.066ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47092025-08-12T22:49:21.066ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.182878ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47102025-08-12T22:49:21.068ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47112025-08-12T22:49:21.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47122025-08-12T22:49:21.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47132025-08-12T22:49:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47142025-08-12T22:49:21.071ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47152025-08-12T22:49:21.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47162025-08-12T22:49:21.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
47172025-08-12T22:49:21.071ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47182025-08-12T22:49:21.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47192025-08-12T22:49:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47202025-08-12T22:49:21.072ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47212025-08-12T22:49:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47222025-08-12T22:49:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
47232025-08-12T22:49:21.077ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
47242025-08-12T22:49:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
47252025-08-12T22:49:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47262025-08-12T22:49:21.077ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47272025-08-12T22:49:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47282025-08-12T22:49:21.082ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47292025-08-12T22:49:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47302025-08-12T22:49:21.083ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 38.472098ms iteration = 7 status = {"dispatched":[],"errors":[],"glob_version":"180.0.0","globs_reprocessed":{},"no_receivers":[]}
47312025-08-12T22:49:21.088ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 43.901781ms iteration = 4 status = {"nsuccess":5}
47322025-08-12T22:49:21.091ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47332025-08-12T22:49:21.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47342025-08-12T22:49:21.093ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47352025-08-12T22:49:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47362025-08-12T22:49:21.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.301151ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
47372025-08-12T22:49:21.113ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
47382025-08-12T22:49:21.113ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
47392025-08-12T22:49:21.113ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
47402025-08-12T22:49:21.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47412025-08-12T22:49:21.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47422025-08-12T22:49:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47432025-08-12T22:49:21.114ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47442025-08-12T22:49:21.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47452025-08-12T22:49:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47462025-08-12T22:49:21.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47472025-08-12T22:49:21.117ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47482025-08-12T22:49:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47492025-08-12T22:49:21.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47502025-08-12T22:49:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47512025-08-12T22:49:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47522025-08-12T22:49:21.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47532025-08-12T22:49:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47542025-08-12T22:49:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47552025-08-12T22:49:21.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.881134ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47562025-08-12T22:49:21.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47572025-08-12T22:49:21.120ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47582025-08-12T22:49:21.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47592025-08-12T22:49:21.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47602025-08-12T22:49:21.121ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1363, tv_nsec: 357972137 } })
47612025-08-12T22:49:21.121ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47622025-08-12T22:49:21.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47632025-08-12T22:49:21.121ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47642025-08-12T22:49:21.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47652025-08-12T22:49:21.121ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
47662025-08-12T22:49:21.121ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47672025-08-12T22:49:21.123ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
47682025-08-12T22:49:21.123ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
47692025-08-12T22:49:21.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47702025-08-12T22:49:21.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47712025-08-12T22:49:21.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
47722025-08-12T22:49:21.124ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47732025-08-12T22:49:21.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47742025-08-12T22:49:21.125ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47752025-08-12T22:49:21.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
47762025-08-12T22:49:21.125ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47772025-08-12T22:49:21.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47782025-08-12T22:49:21.129ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47792025-08-12T22:49:21.129ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47802025-08-12T22:49:21.129ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 84.344727ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47812025-08-12T22:49:21.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47822025-08-12T22:49:21.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47832025-08-12T22:49:21.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47842025-08-12T22:49:21.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47852025-08-12T22:49:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47862025-08-12T22:49:21.133ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
47872025-08-12T22:49:21.133ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
47882025-08-12T22:49:21.133ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
47892025-08-12T22:49:21.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47902025-08-12T22:49:21.133ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
47912025-08-12T22:49:21.133ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
47922025-08-12T22:49:21.133ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-12 22:43:49.909589 UTC dns_group = internal generation = 1
47932025-08-12T22:49:21.133ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 89.049823ms iteration = 7 status = {"generation":1}
47942025-08-12T22:49:21.133ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47952025-08-12T22:49:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47962025-08-12T22:49:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47972025-08-12T22:49:21.134ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47982025-08-12T22:49:21.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47992025-08-12T22:49:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48002025-08-12T22:49:21.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48012025-08-12T22:49:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48022025-08-12T22:49:21.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
48032025-08-12T22:49:21.139ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48042025-08-12T22:49:21.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48052025-08-12T22:49:21.140ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
48062025-08-12T22:49:21.140ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 0 version = 2
48072025-08-12T22:49:21.140ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48082025-08-12T22:49:21.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48092025-08-12T22:49:21.141ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
48102025-08-12T22:49:21.141ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 96.947921ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
48112025-08-12T22:49:21.141ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
48122025-08-12T22:49:21.141ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.983441ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
48132025-08-12T22:49:21.142ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.144243ms iteration = 13 status = 0
48142025-08-12T22:49:21.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48152025-08-12T22:49:21.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48162025-08-12T22:49:21.146ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48172025-08-12T22:49:21.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48182025-08-12T22:49:21.148ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 4 version = 2
48192025-08-12T22:49:21.148ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
48202025-08-12T22:49:21.148ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-12 22:43:50.527483 UTC dns_group = external generation = 2
48212025-08-12T22:49:21.148ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 104.442334ms iteration = 7 status = {"generation":2}
48222025-08-12T22:49:21.152ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 107.398833ms iteration = 15 status = {"physical_disks_added":0}
48232025-08-12T22:49:21.152ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-12T22:43:09.981233Z, time_modified: 2025-08-12T22:43:09.981233Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }) }
48242025-08-12T22:49:21.152ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 108.0625ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]}},"default_endpoint":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
48252025-08-12T22:49:21.158ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48262025-08-12T22:49:21.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48272025-08-12T22:49:21.159ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 114.699585ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48282025-08-12T22:49:21.162ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
48292025-08-12T22:49:21.162ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
48302025-08-12T22:49:21.162ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 117.992477ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
48312025-08-12T22:49:21.197ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
48322025-08-12T22:49:21.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48332025-08-12T22:49:21.204ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.557305ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
48342025-08-12T22:49:21.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48352025-08-12T22:49:21.207ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48362025-08-12T22:49:21.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
48372025-08-12T22:49:21.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5a9fddc5-95f3-4ebb-8722-3b2e23d180c6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
48382025-08-12T22:49:21.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5a9fddc5-95f3-4ebb-8722-3b2e23d180c6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
48392025-08-12T22:49:21.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5a9fddc5-95f3-4ebb-8722-3b2e23d180c6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
48402025-08-12T22:49:21.265ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
48412025-08-12T22:49:21.265ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48422025-08-12T22:49:21.265ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "78f6e813-b3af-443e-a4ad-910b96013375", "content-length": "26", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} })
48432025-08-12T22:49:21.265ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48442025-08-12T22:49:21.267ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48452025-08-12T22:49:21.311ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48462025-08-12T22:49:21.312ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48472025-08-12T22:49:21.312ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b270d5b5-8e8f-47f8-a729-b5b488843835", "content-length": "372", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} })
48482025-08-12T22:49:21.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48492025-08-12T22:49:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48502025-08-12T22:49:21.330ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
48512025-08-12T22:49:21.330ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 286.106967ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
48522025-08-12T22:49:21.340ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48532025-08-12T22:49:21.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48542025-08-12T22:49:21.342ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
48552025-08-12T22:49:21.342ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48562025-08-12T22:49:21.342ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48572025-08-12T22:49:21.342ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "952dc580-425a-477f-b3fa-08298a54ee0d", "content-length": "26", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} })
48582025-08-12T22:49:21.342ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48592025-08-12T22:49:21.344ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48602025-08-12T22:49:21.345ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48612025-08-12T22:49:21.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48622025-08-12T22:49:21.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48632025-08-12T22:49:21.348ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
48642025-08-12T22:49:21.348ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
48652025-08-12T22:49:21.348ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48662025-08-12T22:49:21.349ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2d9df0b-75a8-4add-9c6e-fdc859aa75d9", "content-length": "26", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} })
48672025-08-12T22:49:21.349ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48682025-08-12T22:49:21.351ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
48692025-08-12T22:49:21.356ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
48702025-08-12T22:49:21.393ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
48712025-08-12T22:49:21.393ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48722025-08-12T22:49:21.393ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "333d4ac5-1bda-40c6-92cc-1c94e02d18e3", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} })
48732025-08-12T22:49:21.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48742025-08-12T22:49:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48752025-08-12T22:49:21.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48762025-08-12T22:49:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48772025-08-12T22:49:21.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48782025-08-12T22:49:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48792025-08-12T22:49:21.403ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48802025-08-12T22:49:21.406ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48812025-08-12T22:49:21.406ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48822025-08-12T22:49:21.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48832025-08-12T22:49:21.406ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48842025-08-12T22:49:21.407ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "faf337fd-a3e1-4d89-8d74-c25e99854182", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} })
48852025-08-12T22:49:21.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48862025-08-12T22:49:21.408ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 364.139012ms iteration = 13 status = {}
48872025-08-12T22:49:21.466ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48882025-08-12T22:49:21.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48892025-08-12T22:49:21.471ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 427.272491ms iteration = 13 status = null
48902025-08-12T22:49:21.481ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 437.183947ms iteration = 13 status = {}
48912025-08-12T22:49:21.488ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
48922025-08-12T22:49:21.489ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5c8f61ac-88ff-4081-872d-6d828933dcd9", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48932025-08-12T22:49:21.489ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48942025-08-12T22:49:21.491ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d68de9cf-4a51-459e-9ee4-0258d64e3e9b", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48952025-08-12T22:49:21.491ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48962025-08-12T22:49:21.493ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
48972025-08-12T22:49:21.493ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "90726b02-27b7-48aa-90e7-42dfa1a67ba2", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48982025-08-12T22:49:21.493ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
48992025-08-12T22:49:21.494ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ab9b2d77-85f9-408f-952d-90d8140ed9c9", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49002025-08-12T22:49:21.494ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49012025-08-12T22:49:21.496ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
49022025-08-12T22:49:21.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 451.950093ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
49032025-08-12T22:49:21.496ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "07612d5c-ace4-41fb-87fd-b66c18e459a4", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49042025-08-12T22:49:21.496ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49052025-08-12T22:49:21.499ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49062025-08-12T22:49:21.499ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 454.850101ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
49072025-08-12T22:49:21.553ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49082025-08-12T22:49:21.553ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "074365a5-902b-42ba-83af-2665e23a86f8", "content-length": "691", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} })
49092025-08-12T22:49:21.553ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
49102025-08-12T22:49:21.553ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
49112025-08-12T22:49:21.553ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
49122025-08-12T22:49:21.554ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 509.76059ms iteration = 13 status = {}
49132025-08-12T22:49:21.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49142025-08-12T22:49:21.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49152025-08-12T22:49:21.569ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
49162025-08-12T22:49:21.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49172025-08-12T22:49:21.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49182025-08-12T22:49:21.590ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
49192025-08-12T22:49:21.590ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
49202025-08-12T22:49:21.591ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
49212025-08-12T22:49:21.591ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49222025-08-12T22:49:21.591ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49232025-08-12T22:49:21.591ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49242025-08-12T22:49:21.591ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49252025-08-12T22:49:21.591ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49262025-08-12T22:49:21.591ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49272025-08-12T22:49:21.591ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49282025-08-12T22:49:21.591ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
49292025-08-12T22:49:21.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49302025-08-12T22:49:21.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49312025-08-12T22:49:21.594ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
49322025-08-12T22:49:21.594ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49332025-08-12T22:49:21.712ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5eb626be-52be-4618-a738-d822352da35c", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} })
49342025-08-12T22:49:21.712ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
49352025-08-12T22:49:21.712ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49362025-08-12T22:49:21.712ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "28d1f0f2-576c-47d4-8b2b-56e9459c3266", "content-length": "682", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} })
49372025-08-12T22:49:21.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49382025-08-12T22:49:21.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49392025-08-12T22:49:21.717ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49402025-08-12T22:49:21.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49412025-08-12T22:49:21.720ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49422025-08-12T22:49:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49432025-08-12T22:49:21.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49442025-08-12T22:49:21.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49452025-08-12T22:49:21.731ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 686.24684ms iteration = 13 status = {}
49462025-08-12T22:49:21.744ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 2
49472025-08-12T22:49:21.744ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221
49482025-08-12T22:49:21.776ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
49492025-08-12T22:49:21.776ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:43992
49502025-08-12T22:49:21.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43992 req_id = cd78e92b-042b-42df-87b5-8d5163c2e845 roles = RoleSet { roles: {} } uri = /metrics/producers
49512025-08-12T22:49:21.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43992 req_id = cd78e92b-042b-42df-87b5-8d5163c2e845 resource = Database result = Ok(()) uri = /metrics/producers
49522025-08-12T22:49:21.824ZINFOnexus: assigned collector to new producer collector_id = 4c467f25-cb67-42ad-b276-c490b467a350 file = nexus/src/app/oximeter.rs:76 producer_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
49532025-08-12T22:49:21.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 48128 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43992 req_id = cd78e92b-042b-42df-87b5-8d5163c2e845 response_code = 201 uri = /metrics/producers
49542025-08-12T22:49:21.824ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "cd78e92b-042b-42df-87b5-8d5163c2e845", "content-length": "41", "date": "Tue, 12 Aug 2025 22:49:21 GMT"} })
49552025-08-12T22:49:21.825ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
49562025-08-12T22:49:22.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 509d63b5-3298-490f-82d7-24bfad0069c4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49572025-08-12T22:49:22.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 509d63b5-3298-490f-82d7-24bfad0069c4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49582025-08-12T22:49:22.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 509d63b5-3298-490f-82d7-24bfad0069c4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49592025-08-12T22:49:23.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a96c2e19-8d52-48c9-ac57-b33ff630ecce roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49602025-08-12T22:49:23.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a96c2e19-8d52-48c9-ac57-b33ff630ecce resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49612025-08-12T22:49:23.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a96c2e19-8d52-48c9-ac57-b33ff630ecce response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49622025-08-12T22:49:24.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 63799a03-c26b-4ce4-b82f-d7050e7edcc1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49632025-08-12T22:49:24.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 63799a03-c26b-4ce4-b82f-d7050e7edcc1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49642025-08-12T22:49:24.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 63799a03-c26b-4ce4-b82f-d7050e7edcc1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49652025-08-12T22:49:25.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 983e03ee-c91f-4b72-a51a-b0889b19a5a1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49662025-08-12T22:49:25.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 983e03ee-c91f-4b72-a51a-b0889b19a5a1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49672025-08-12T22:49:25.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 983e03ee-c91f-4b72-a51a-b0889b19a5a1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49682025-08-12T22:49:26.045ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 74 reason = Timeout
49692025-08-12T22:49:26.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
49702025-08-12T22:49:26.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
49712025-08-12T22:49:26.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49722025-08-12T22:49:26.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
49732025-08-12T22:49:26.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
49742025-08-12T22:49:26.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
49752025-08-12T22:49:26.052ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
49762025-08-12T22:49:26.052ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.122049ms iteration = 74 status = {"chicken_switches_updated":false}
49772025-08-12T22:49:26.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 20ad3955-b431-4af5-8e74-3fcfbfb1e27c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49782025-08-12T22:49:26.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 20ad3955-b431-4af5-8e74-3fcfbfb1e27c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49792025-08-12T22:49:26.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 20ad3955-b431-4af5-8e74-3fcfbfb1e27c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49802025-08-12T22:49:27.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e660d809-fed1-4988-a320-72e7aa0b573c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49812025-08-12T22:49:27.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e660d809-fed1-4988-a320-72e7aa0b573c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49822025-08-12T22:49:27.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e660d809-fed1-4988-a320-72e7aa0b573c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49832025-08-12T22:49:28.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f6c7f271-dbd2-47db-87e7-15fc2eed943c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49842025-08-12T22:49:28.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f6c7f271-dbd2-47db-87e7-15fc2eed943c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49852025-08-12T22:49:28.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f6c7f271-dbd2-47db-87e7-15fc2eed943c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49862025-08-12T22:49:28.832ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 550 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 4061b0dc-904d-4c15-8c5b-1c926e4623d5 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
49872025-08-12T22:49:29.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 529019a0-736e-428e-a9bb-8f17caa7881e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49882025-08-12T22:49:29.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 529019a0-736e-428e-a9bb-8f17caa7881e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49892025-08-12T22:49:29.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 529019a0-736e-428e-a9bb-8f17caa7881e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49902025-08-12T22:49:30.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6a6f559d-963e-4bf7-94c4-4cec22396f74 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49912025-08-12T22:49:30.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6a6f559d-963e-4bf7-94c4-4cec22396f74 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49922025-08-12T22:49:30.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6a6f559d-963e-4bf7-94c4-4cec22396f74 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
49932025-08-12T22:49:31.045ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
49942025-08-12T22:49:31.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49952025-08-12T22:49:31.045ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
49962025-08-12T22:49:31.045ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 75 reason = Timeout
49972025-08-12T22:49:31.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
49982025-08-12T22:49:31.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49992025-08-12T22:49:31.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50002025-08-12T22:49:31.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
50012025-08-12T22:49:31.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50022025-08-12T22:49:31.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50032025-08-12T22:49:31.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50042025-08-12T22:49:31.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50052025-08-12T22:49:31.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50062025-08-12T22:49:31.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50072025-08-12T22:49:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50082025-08-12T22:49:31.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50092025-08-12T22:49:31.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
50102025-08-12T22:49:31.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50112025-08-12T22:49:31.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50122025-08-12T22:49:31.074ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
50132025-08-12T22:49:31.074ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.708291ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
50142025-08-12T22:49:31.081ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50152025-08-12T22:49:31.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50162025-08-12T22:49:31.091ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50172025-08-12T22:49:31.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
50182025-08-12T22:49:31.094ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
50192025-08-12T22:49:31.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
50202025-08-12T22:49:31.096ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
50212025-08-12T22:49:31.096ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 50.477715ms iteration = 75 status = {"chicken_switches_updated":false}
50222025-08-12T22:49:31.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.552321ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50232025-08-12T22:49:31.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 99c325fc-6d4f-44c4-9c45-11f553bef98a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50242025-08-12T22:49:31.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 99c325fc-6d4f-44c4-9c45-11f553bef98a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50252025-08-12T22:49:31.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 99c325fc-6d4f-44c4-9c45-11f553bef98a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50262025-08-12T22:49:32.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be78b555-0168-44d0-bf82-a829fe9f4e41 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50272025-08-12T22:49:32.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be78b555-0168-44d0-bf82-a829fe9f4e41 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50282025-08-12T22:49:32.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be78b555-0168-44d0-bf82-a829fe9f4e41 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50292025-08-12T22:49:33.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 39cadfdd-7d0b-41a5-a9c9-eb240647651e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50302025-08-12T22:49:33.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 39cadfdd-7d0b-41a5-a9c9-eb240647651e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50312025-08-12T22:49:33.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 39cadfdd-7d0b-41a5-a9c9-eb240647651e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50322025-08-12T22:49:34.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 97fdd91e-836f-438d-8546-4f7c0433bffa roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50332025-08-12T22:49:34.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 97fdd91e-836f-438d-8546-4f7c0433bffa resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50342025-08-12T22:49:34.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 97fdd91e-836f-438d-8546-4f7c0433bffa response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50352025-08-12T22:49:35.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 59cfc353-018d-48dd-97b9-a753f054b466 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50362025-08-12T22:49:35.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 59cfc353-018d-48dd-97b9-a753f054b466 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50372025-08-12T22:49:35.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 59cfc353-018d-48dd-97b9-a753f054b466 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50382025-08-12T22:49:36.045ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 76 reason = Timeout
50392025-08-12T22:49:36.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
50402025-08-12T22:49:36.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
50412025-08-12T22:49:36.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50422025-08-12T22:49:36.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
50432025-08-12T22:49:36.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
50442025-08-12T22:49:36.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
50452025-08-12T22:49:36.052ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
50462025-08-12T22:49:36.052ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.424403ms iteration = 76 status = {"chicken_switches_updated":false}
50472025-08-12T22:49:36.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be7945d8-0099-4494-a7cf-3f4ec854ceec roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50482025-08-12T22:49:36.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be7945d8-0099-4494-a7cf-3f4ec854ceec resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50492025-08-12T22:49:36.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be7945d8-0099-4494-a7cf-3f4ec854ceec response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50502025-08-12T22:49:37.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f6556aa4-7f8d-433b-87d2-32c3f7e55765 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50512025-08-12T22:49:37.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f6556aa4-7f8d-433b-87d2-32c3f7e55765 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50522025-08-12T22:49:37.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f6556aa4-7f8d-433b-87d2-32c3f7e55765 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50532025-08-12T22:49:38.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dd93790b-e1dc-4c94-b8ee-9652fac0bfb8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50542025-08-12T22:49:38.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dd93790b-e1dc-4c94-b8ee-9652fac0bfb8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50552025-08-12T22:49:38.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dd93790b-e1dc-4c94-b8ee-9652fac0bfb8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50562025-08-12T22:49:38.833ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 541 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 6fdd4ed7-0aa4-4840-b095-baa7b2a5279b response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
50572025-08-12T22:49:39.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f15af955-45e3-4e5c-83c2-10a4382d5e6b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50582025-08-12T22:49:39.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f15af955-45e3-4e5c-83c2-10a4382d5e6b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50592025-08-12T22:49:39.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f15af955-45e3-4e5c-83c2-10a4382d5e6b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50602025-08-12T22:49:40.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = deece64a-729e-44c3-9255-d867e81c734d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50612025-08-12T22:49:40.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = deece64a-729e-44c3-9255-d867e81c734d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50622025-08-12T22:49:40.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = deece64a-729e-44c3-9255-d867e81c734d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50632025-08-12T22:49:41.045ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
50642025-08-12T22:49:41.045ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
50652025-08-12T22:49:41.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50662025-08-12T22:49:41.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50672025-08-12T22:49:41.045ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 77 reason = Timeout
50682025-08-12T22:49:41.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
50692025-08-12T22:49:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50702025-08-12T22:49:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
50712025-08-12T22:49:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50722025-08-12T22:49:41.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50732025-08-12T22:49:41.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50742025-08-12T22:49:41.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
50752025-08-12T22:49:41.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
50762025-08-12T22:49:41.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
50772025-08-12T22:49:41.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50782025-08-12T22:49:41.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50792025-08-12T22:49:41.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50802025-08-12T22:49:41.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50812025-08-12T22:49:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50822025-08-12T22:49:41.052ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
50832025-08-12T22:49:41.052ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.984798ms iteration = 77 status = {"chicken_switches_updated":false}
50842025-08-12T22:49:41.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50852025-08-12T22:49:41.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
50862025-08-12T22:49:41.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50872025-08-12T22:49:41.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50882025-08-12T22:49:41.074ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
50892025-08-12T22:49:41.074ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.821593ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
50902025-08-12T22:49:41.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50912025-08-12T22:49:41.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50922025-08-12T22:49:41.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.440497ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50932025-08-12T22:49:41.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 27c50006-f528-448d-85ca-a024dfc68521 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50942025-08-12T22:49:41.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 27c50006-f528-448d-85ca-a024dfc68521 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50952025-08-12T22:49:41.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 27c50006-f528-448d-85ca-a024dfc68521 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50962025-08-12T22:49:42.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cfbfb7f9-f0d5-4045-a76f-2f99d197d7a6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50972025-08-12T22:49:42.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cfbfb7f9-f0d5-4045-a76f-2f99d197d7a6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50982025-08-12T22:49:42.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cfbfb7f9-f0d5-4045-a76f-2f99d197d7a6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
50992025-08-12T22:49:43.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d3fd4f16-f2ff-41a2-8fe3-152b8d3db2fc roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51002025-08-12T22:49:43.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d3fd4f16-f2ff-41a2-8fe3-152b8d3db2fc resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51012025-08-12T22:49:43.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d3fd4f16-f2ff-41a2-8fe3-152b8d3db2fc response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51022025-08-12T22:49:44.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5ea1b331-ad1f-43d1-9e64-644511bf2c31 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51032025-08-12T22:49:44.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5ea1b331-ad1f-43d1-9e64-644511bf2c31 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51042025-08-12T22:49:44.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5ea1b331-ad1f-43d1-9e64-644511bf2c31 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51052025-08-12T22:49:45.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7e64fa2a-162f-4d98-942a-ad201fa66ec5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51062025-08-12T22:49:45.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7e64fa2a-162f-4d98-942a-ad201fa66ec5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51072025-08-12T22:49:45.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7e64fa2a-162f-4d98-942a-ad201fa66ec5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51082025-08-12T22:49:46.045ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 78 reason = Timeout
51092025-08-12T22:49:46.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
51102025-08-12T22:49:46.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
51112025-08-12T22:49:46.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51122025-08-12T22:49:46.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
51132025-08-12T22:49:46.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
51142025-08-12T22:49:46.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
51152025-08-12T22:49:46.051ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
51162025-08-12T22:49:46.051ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.631875ms iteration = 78 status = {"chicken_switches_updated":false}
51172025-08-12T22:49:46.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d0b861d5-b135-4e44-b6ed-a91fe629121b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51182025-08-12T22:49:46.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d0b861d5-b135-4e44-b6ed-a91fe629121b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51192025-08-12T22:49:46.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d0b861d5-b135-4e44-b6ed-a91fe629121b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51202025-08-12T22:49:47.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7223bfb0-75d6-40bf-a124-2e8aeaf85fdf roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51212025-08-12T22:49:47.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7223bfb0-75d6-40bf-a124-2e8aeaf85fdf resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51222025-08-12T22:49:47.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7223bfb0-75d6-40bf-a124-2e8aeaf85fdf response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51232025-08-12T22:49:48.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 884820cd-4378-4a76-bf3d-83d7c749e519 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51242025-08-12T22:49:48.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 884820cd-4378-4a76-bf3d-83d7c749e519 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51252025-08-12T22:49:48.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 884820cd-4378-4a76-bf3d-83d7c749e519 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51262025-08-12T22:49:48.833ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 572 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 293098f6-4fdc-44b9-bea8-7c73f0193ae4 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
51272025-08-12T22:49:49.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 53df4760-f4fc-4640-88a1-31d25c7f2939 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51282025-08-12T22:49:49.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 53df4760-f4fc-4640-88a1-31d25c7f2939 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51292025-08-12T22:49:49.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 53df4760-f4fc-4640-88a1-31d25c7f2939 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51302025-08-12T22:49:50.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2663e698-468c-4e43-8fb0-dcb8def9a9f1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51312025-08-12T22:49:50.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2663e698-468c-4e43-8fb0-dcb8def9a9f1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51322025-08-12T22:49:50.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2663e698-468c-4e43-8fb0-dcb8def9a9f1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
51332025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
51342025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
51352025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
51362025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51372025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
51382025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
51392025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 14 reason = Timeout
51402025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51412025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
51422025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51432025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
51442025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 24.43\u{b5}s iteration = 14 status = {"disabled":true,"errors":[],"sps":[]}
51452025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51462025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
51472025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
51482025-08-12T22:49:51.045ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
51492025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51502025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51512025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
51522025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51532025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
51542025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
51552025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51562025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51572025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 79 reason = Timeout
51582025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
51592025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
51602025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51612025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51622025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
51632025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51642025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
51652025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
51662025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
51672025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
51682025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51692025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51702025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 14 reason = Timeout
51712025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
51722025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
51732025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
51742025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
51752025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51762025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51772025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51782025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51792025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
51802025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51812025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51822025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51832025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51842025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51852025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51862025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
51872025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51882025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51892025-08-12T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
51902025-08-12T22:49:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51912025-08-12T22:49:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51922025-08-12T22:49:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51932025-08-12T22:49:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51942025-08-12T22:49:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
51952025-08-12T22:49:51.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51962025-08-12T22:49:51.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51972025-08-12T22:49:51.048ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1393, tv_nsec: 284754185 } })
51982025-08-12T22:49:51.048ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1393, tv_nsec: 284868726 } })
51992025-08-12T22:49:51.048ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
52002025-08-12T22:49:51.049ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.670496ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52012025-08-12T22:49:51.049ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
52022025-08-12T22:49:51.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52032025-08-12T22:49:51.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52042025-08-12T22:49:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52052025-08-12T22:49:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
52062025-08-12T22:49:51.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52072025-08-12T22:49:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52082025-08-12T22:49:51.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52092025-08-12T22:49:51.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52102025-08-12T22:49:51.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52112025-08-12T22:49:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52122025-08-12T22:49:51.064ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52132025-08-12T22:49:51.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52142025-08-12T22:49:51.099ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52152025-08-12T22:49:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
52162025-08-12T22:49:51.101ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52172025-08-12T22:49:51.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52182025-08-12T22:49:51.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52192025-08-12T22:49:51.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.085789ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
52202025-08-12T22:49:51.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52212025-08-12T22:49:51.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52222025-08-12T22:49:51.103ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52232025-08-12T22:49:51.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52242025-08-12T22:49:51.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52252025-08-12T22:49:51.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52262025-08-12T22:49:51.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52272025-08-12T22:49:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52282025-08-12T22:49:51.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52292025-08-12T22:49:51.106ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52302025-08-12T22:49:51.106ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.19888ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52312025-08-12T22:49:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52322025-08-12T22:49:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52332025-08-12T22:49:51.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52342025-08-12T22:49:51.108ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52352025-08-12T22:49:51.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52362025-08-12T22:49:51.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52372025-08-12T22:49:51.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52382025-08-12T22:49:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
52392025-08-12T22:49:51.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52402025-08-12T22:49:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52412025-08-12T22:49:51.110ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52422025-08-12T22:49:51.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52432025-08-12T22:49:51.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
52442025-08-12T22:49:51.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52452025-08-12T22:49:51.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52462025-08-12T22:49:51.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52472025-08-12T22:49:51.111ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52482025-08-12T22:49:51.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52492025-08-12T22:49:51.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52502025-08-12T22:49:51.112ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 66.999928ms iteration = 14 status = {"errors":[],"requests_created_ok":[]}
52512025-08-12T22:49:51.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52522025-08-12T22:49:51.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52532025-08-12T22:49:51.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52542025-08-12T22:49:51.113ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1393, tv_nsec: 350161177 } })
52552025-08-12T22:49:51.114ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
52562025-08-12T22:49:51.114ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.790805ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
52572025-08-12T22:49:51.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
52582025-08-12T22:49:51.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52592025-08-12T22:49:51.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52602025-08-12T22:49:51.119ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52612025-08-12T22:49:51.119ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
52622025-08-12T22:49:51.119ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52632025-08-12T22:49:51.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52642025-08-12T22:49:51.121ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52652025-08-12T22:49:51.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
52662025-08-12T22:49:51.124ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
52672025-08-12T22:49:51.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
52682025-08-12T22:49:51.126ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
52692025-08-12T22:49:51.126ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 80.668051ms iteration = 79 status = {"chicken_switches_updated":false}
52702025-08-12T22:49:51.126ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52712025-08-12T22:49:51.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52722025-08-12T22:49:51.131ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52732025-08-12T22:49:51.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52742025-08-12T22:49:51.133ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52752025-08-12T22:49:51.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
52762025-08-12T22:49:51.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52772025-08-12T22:49:51.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52782025-08-12T22:49:51.138ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.614858ms iteration = 14 status = 0
52792025-08-12T22:49:51.139ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
52802025-08-12T22:49:51.139ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.565088ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
52812025-08-12T22:49:51.149ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52822025-08-12T22:49:51.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52832025-08-12T22:49:51.151ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52842025-08-12T22:49:51.151ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.615676ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52852025-08-12T22:49:51.153ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52862025-08-12T22:49:51.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52872025-08-12T22:49:51.153ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 108.404703ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52882025-08-12T22:49:51.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
52892025-08-12T22:49:51.153ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52902025-08-12T22:49:51.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52912025-08-12T22:49:51.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 109.974019ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
52922025-08-12T22:49:51.159ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
52932025-08-12T22:49:51.159ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52942025-08-12T22:49:51.159ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7cc1bb0-9562-40d8-a81a-a06c6bfc25a3", "content-length": "26", "date": "Tue, 12 Aug 2025 22:49:51 GMT"} })
52952025-08-12T22:49:51.159ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52962025-08-12T22:49:51.161ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52972025-08-12T22:49:51.163ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52982025-08-12T22:49:51.163ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.052129ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52992025-08-12T22:49:51.166ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53002025-08-12T22:49:51.166ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53012025-08-12T22:49:51.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53022025-08-12T22:49:51.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53032025-08-12T22:49:51.179ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53042025-08-12T22:49:51.179ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53052025-08-12T22:49:51.180ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfb03ffa-4be0-4acd-92e9-45025eb9c2fd", "content-length": "372", "date": "Tue, 12 Aug 2025 22:49:51 GMT"} })
53062025-08-12T22:49:51.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53072025-08-12T22:49:51.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53082025-08-12T22:49:51.193ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
53092025-08-12T22:49:51.193ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 147.84084ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
53102025-08-12T22:49:51.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53112025-08-12T22:49:51.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53122025-08-12T22:49:51.208ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53132025-08-12T22:49:51.208ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53142025-08-12T22:49:51.208ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 162.814967ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
53152025-08-12T22:49:51.234ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
53162025-08-12T22:49:51.234ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53172025-08-12T22:49:51.234ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "39df7e49-797e-4e28-a547-475aea065583", "date": "Tue, 12 Aug 2025 22:49:51 GMT"} })
53182025-08-12T22:49:51.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53192025-08-12T22:49:51.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53202025-08-12T22:49:51.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53212025-08-12T22:49:51.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53222025-08-12T22:49:51.238ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
53232025-08-12T22:49:51.238ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53242025-08-12T22:49:51.238ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 192.707191ms iteration = 16 status = {"physical_disks_added":0}
53252025-08-12T22:49:51.238ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1703848-7dfb-4b71-9386-204770d61404", "content-length": "26", "date": "Tue, 12 Aug 2025 22:49:51 GMT"} })
53262025-08-12T22:49:51.238ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53272025-08-12T22:49:51.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53282025-08-12T22:49:51.240ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53292025-08-12T22:49:51.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53302025-08-12T22:49:51.244ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53312025-08-12T22:49:51.244ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53322025-08-12T22:49:51.244ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0a7d47fd-2f42-4bf9-ae0c-3e9e91440ea0", "date": "Tue, 12 Aug 2025 22:49:51 GMT"} })
53332025-08-12T22:49:51.245ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 200.628718ms iteration = 14 status = {}
53342025-08-12T22:49:51.282ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
53352025-08-12T22:49:51.282ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53362025-08-12T22:49:51.282ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f9bb1fe-a8ea-4980-86f0-6a24d35a93eb", "content-length": "26", "date": "Tue, 12 Aug 2025 22:49:51 GMT"} })
53372025-08-12T22:49:51.282ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53382025-08-12T22:49:51.283ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
53392025-08-12T22:49:51.296ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 251.80161ms iteration = 14 status = {}
53402025-08-12T22:49:51.322ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53412025-08-12T22:49:51.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53422025-08-12T22:49:51.324ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53432025-08-12T22:49:51.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53442025-08-12T22:49:51.326ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53452025-08-12T22:49:51.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53462025-08-12T22:49:51.328ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53472025-08-12T22:49:51.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53482025-08-12T22:49:51.330ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53492025-08-12T22:49:51.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53502025-08-12T22:49:51.359ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53512025-08-12T22:49:51.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53522025-08-12T22:49:51.362ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 316.893248ms iteration = 14 status = null
53532025-08-12T22:49:51.416ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53542025-08-12T22:49:51.417ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "319ca4d6-29a7-4486-88c3-2e878871741a", "content-length": "691", "date": "Tue, 12 Aug 2025 22:49:51 GMT"} })
53552025-08-12T22:49:51.417ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
53562025-08-12T22:49:51.417ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
53572025-08-12T22:49:51.417ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
53582025-08-12T22:49:51.420ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 375.315341ms iteration = 14 status = {}
53592025-08-12T22:49:51.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53602025-08-12T22:49:51.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53612025-08-12T22:49:51.470ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
53622025-08-12T22:49:51.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53632025-08-12T22:49:51.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53642025-08-12T22:49:51.482ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
53652025-08-12T22:49:51.482ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
53662025-08-12T22:49:51.483ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53672025-08-12T22:49:51.483ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53682025-08-12T22:49:51.483ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53692025-08-12T22:49:51.483ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53702025-08-12T22:49:51.483ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53712025-08-12T22:49:51.483ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53722025-08-12T22:49:51.483ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53732025-08-12T22:49:51.483ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53742025-08-12T22:49:51.483ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
53752025-08-12T22:49:51.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53762025-08-12T22:49:51.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53772025-08-12T22:49:51.486ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
53782025-08-12T22:49:51.486ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53792025-08-12T22:49:51.599ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "128207b5-9fe1-4f39-a874-866b85d4c312", "date": "Tue, 12 Aug 2025 22:49:51 GMT"} })
53802025-08-12T22:49:51.599ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
53812025-08-12T22:49:51.599ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
53822025-08-12T22:49:51.606ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "55bbe1c2-8294-4e70-b926-981779270cf8", "content-length": "682", "date": "Tue, 12 Aug 2025 22:49:51 GMT"} })
53832025-08-12T22:49:51.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53842025-08-12T22:49:51.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53852025-08-12T22:49:51.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53862025-08-12T22:49:51.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53872025-08-12T22:49:51.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53882025-08-12T22:49:51.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53892025-08-12T22:49:51.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53902025-08-12T22:49:51.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53912025-08-12T22:49:51.623ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 577.933828ms iteration = 14 status = {}
53922025-08-12T22:49:51.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a598411c-decb-4903-ab26-3300fab77c06 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
53932025-08-12T22:49:51.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a598411c-decb-4903-ab26-3300fab77c06 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
53942025-08-12T22:49:51.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a598411c-decb-4903-ab26-3300fab77c06 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
53952025-08-12T22:49:52.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8d693f5b-61cd-452a-8603-a89b2e807cb0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
53962025-08-12T22:49:52.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8d693f5b-61cd-452a-8603-a89b2e807cb0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
53972025-08-12T22:49:52.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8d693f5b-61cd-452a-8603-a89b2e807cb0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
53982025-08-12T22:49:53.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3f5d8349-b343-4027-953a-ea1f4fa2854f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
53992025-08-12T22:49:53.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3f5d8349-b343-4027-953a-ea1f4fa2854f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54002025-08-12T22:49:53.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3f5d8349-b343-4027-953a-ea1f4fa2854f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54012025-08-12T22:49:54.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d010774-6fa1-4b7a-b1eb-e4d57c0583b7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54022025-08-12T22:49:54.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d010774-6fa1-4b7a-b1eb-e4d57c0583b7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54032025-08-12T22:49:54.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d010774-6fa1-4b7a-b1eb-e4d57c0583b7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54042025-08-12T22:49:55.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8d0d8d6d-814b-48f5-8f0a-a836c91e9a07 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54052025-08-12T22:49:55.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8d0d8d6d-814b-48f5-8f0a-a836c91e9a07 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54062025-08-12T22:49:55.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8d0d8d6d-814b-48f5-8f0a-a836c91e9a07 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54072025-08-12T22:49:56.046ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 80 reason = Timeout
54082025-08-12T22:49:56.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
54092025-08-12T22:49:56.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
54102025-08-12T22:49:56.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54112025-08-12T22:49:56.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
54122025-08-12T22:49:56.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
54132025-08-12T22:49:56.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
54142025-08-12T22:49:56.053ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
54152025-08-12T22:49:56.053ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.14522ms iteration = 80 status = {"chicken_switches_updated":false}
54162025-08-12T22:49:56.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e1da38b6-b66f-4baf-b06c-141a88b2229b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54172025-08-12T22:49:56.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e1da38b6-b66f-4baf-b06c-141a88b2229b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54182025-08-12T22:49:56.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e1da38b6-b66f-4baf-b06c-141a88b2229b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54192025-08-12T22:49:57.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 568996b7-80c9-4962-be41-d017095e108f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54202025-08-12T22:49:57.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 568996b7-80c9-4962-be41-d017095e108f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54212025-08-12T22:49:57.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 568996b7-80c9-4962-be41-d017095e108f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54222025-08-12T22:49:58.833ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 642 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = c100cd93-bfc8-4464-87c7-8264b6bcd596 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
54232025-08-12T22:49:58.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 54d8f6ca-00dc-403d-ae7f-bda5d73267bc roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54242025-08-12T22:49:58.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 54d8f6ca-00dc-403d-ae7f-bda5d73267bc resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54252025-08-12T22:49:58.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 54d8f6ca-00dc-403d-ae7f-bda5d73267bc response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54262025-08-12T22:49:59.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 20020fbb-9650-4f8f-8051-8857ddcabb22 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54272025-08-12T22:49:59.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 20020fbb-9650-4f8f-8051-8857ddcabb22 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54282025-08-12T22:49:59.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 20020fbb-9650-4f8f-8051-8857ddcabb22 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54292025-08-12T22:50:00.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3cfe975a-d55e-4136-9ba8-ca6ae6e2c23a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54302025-08-12T22:50:00.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3cfe975a-d55e-4136-9ba8-ca6ae6e2c23a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54312025-08-12T22:50:00.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3cfe975a-d55e-4136-9ba8-ca6ae6e2c23a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54322025-08-12T22:50:01.045ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
54332025-08-12T22:50:01.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54342025-08-12T22:50:01.045ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
54352025-08-12T22:50:01.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54362025-08-12T22:50:01.045ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 81 reason = Timeout
54372025-08-12T22:50:01.045ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
54382025-08-12T22:50:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54392025-08-12T22:50:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54402025-08-12T22:50:01.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
54412025-08-12T22:50:01.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54422025-08-12T22:50:01.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54432025-08-12T22:50:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54442025-08-12T22:50:01.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54452025-08-12T22:50:01.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
54462025-08-12T22:50:01.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
54472025-08-12T22:50:01.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
54482025-08-12T22:50:01.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54492025-08-12T22:50:01.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54502025-08-12T22:50:01.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54512025-08-12T22:50:01.052ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
54522025-08-12T22:50:01.052ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.374233ms iteration = 81 status = {"chicken_switches_updated":false}
54532025-08-12T22:50:01.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54542025-08-12T22:50:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54552025-08-12T22:50:01.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54562025-08-12T22:50:01.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
54572025-08-12T22:50:01.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54582025-08-12T22:50:01.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54592025-08-12T22:50:01.074ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
54602025-08-12T22:50:01.074ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.403108ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
54612025-08-12T22:50:01.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.299395ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54622025-08-12T22:50:01.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 204edda1-018c-436f-9cdb-7b9ccee95166 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54632025-08-12T22:50:01.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 204edda1-018c-436f-9cdb-7b9ccee95166 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54642025-08-12T22:50:01.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 204edda1-018c-436f-9cdb-7b9ccee95166 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54652025-08-12T22:50:02.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d64fdbea-2077-403e-a6cd-5cf930c7badc roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54662025-08-12T22:50:02.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d64fdbea-2077-403e-a6cd-5cf930c7badc resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54672025-08-12T22:50:02.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d64fdbea-2077-403e-a6cd-5cf930c7badc response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54682025-08-12T22:50:03.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1055be97-2c54-4eb5-b0b4-5246ad716089 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54692025-08-12T22:50:03.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1055be97-2c54-4eb5-b0b4-5246ad716089 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54702025-08-12T22:50:03.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1055be97-2c54-4eb5-b0b4-5246ad716089 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54712025-08-12T22:50:04.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e5ac0f2-2490-4850-8f74-5f1ed605ba5a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54722025-08-12T22:50:04.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e5ac0f2-2490-4850-8f74-5f1ed605ba5a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54732025-08-12T22:50:04.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e5ac0f2-2490-4850-8f74-5f1ed605ba5a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54742025-08-12T22:50:05.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 40927401-b6d8-4482-a4c1-9ed9968579cf roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54752025-08-12T22:50:05.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 40927401-b6d8-4482-a4c1-9ed9968579cf resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54762025-08-12T22:50:05.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 40927401-b6d8-4482-a4c1-9ed9968579cf response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54772025-08-12T22:50:06.046ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 82 reason = Timeout
54782025-08-12T22:50:06.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
54792025-08-12T22:50:06.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
54802025-08-12T22:50:06.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54812025-08-12T22:50:06.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
54822025-08-12T22:50:06.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
54832025-08-12T22:50:06.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
54842025-08-12T22:50:06.052ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
54852025-08-12T22:50:06.052ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.538864ms iteration = 82 status = {"chicken_switches_updated":false}
54862025-08-12T22:50:06.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dcd1ae3f-de11-4eca-9f03-8a8ee173a3bf roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54872025-08-12T22:50:06.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dcd1ae3f-de11-4eca-9f03-8a8ee173a3bf resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54882025-08-12T22:50:06.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dcd1ae3f-de11-4eca-9f03-8a8ee173a3bf response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54892025-08-12T22:50:08.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 93a15e49-e647-4b6b-ae0b-08a93f34826d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54902025-08-12T22:50:08.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 93a15e49-e647-4b6b-ae0b-08a93f34826d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54912025-08-12T22:50:08.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 93a15e49-e647-4b6b-ae0b-08a93f34826d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54922025-08-12T22:50:08.833ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 577 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 8681379e-6021-43fa-b3a8-322507991a6a response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
54932025-08-12T22:50:09.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 70fd30d9-5530-4eaa-a6db-0a32cf447e96 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54942025-08-12T22:50:09.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 70fd30d9-5530-4eaa-a6db-0a32cf447e96 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54952025-08-12T22:50:09.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 70fd30d9-5530-4eaa-a6db-0a32cf447e96 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54962025-08-12T22:50:10.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 84c26671-1bdd-4ea1-955c-1d949dc33a92 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54972025-08-12T22:50:10.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 84c26671-1bdd-4ea1-955c-1d949dc33a92 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54982025-08-12T22:50:10.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 84c26671-1bdd-4ea1-955c-1d949dc33a92 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
54992025-08-12T22:50:11.046ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
55002025-08-12T22:50:11.046ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
55012025-08-12T22:50:11.046ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 83 reason = Timeout
55022025-08-12T22:50:11.046ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55032025-08-12T22:50:11.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55042025-08-12T22:50:11.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
55052025-08-12T22:50:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55062025-08-12T22:50:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
55072025-08-12T22:50:11.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55082025-08-12T22:50:11.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55092025-08-12T22:50:11.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55102025-08-12T22:50:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
55112025-08-12T22:50:11.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
55122025-08-12T22:50:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55132025-08-12T22:50:11.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55142025-08-12T22:50:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
55152025-08-12T22:50:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55162025-08-12T22:50:11.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55172025-08-12T22:50:11.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55182025-08-12T22:50:11.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55192025-08-12T22:50:11.057ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
55202025-08-12T22:50:11.057ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 10.795786ms iteration = 83 status = {"chicken_switches_updated":false}
55212025-08-12T22:50:11.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
55222025-08-12T22:50:11.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55232025-08-12T22:50:11.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55242025-08-12T22:50:11.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e5798f87-c354-4c3b-a428-a42759f8461e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55252025-08-12T22:50:11.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e5798f87-c354-4c3b-a428-a42759f8461e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55262025-08-12T22:50:11.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e5798f87-c354-4c3b-a428-a42759f8461e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55272025-08-12T22:50:11.078ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
55282025-08-12T22:50:11.078ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.69079ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
55292025-08-12T22:50:11.095ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55302025-08-12T22:50:11.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55312025-08-12T22:50:11.097ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.302893ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55322025-08-12T22:50:12.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f3bfb338-bead-4eb7-9f65-3c26c6203de4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55332025-08-12T22:50:12.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f3bfb338-bead-4eb7-9f65-3c26c6203de4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55342025-08-12T22:50:12.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f3bfb338-bead-4eb7-9f65-3c26c6203de4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55352025-08-12T22:50:13.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 18643e86-2c70-44ba-8611-0af99128d366 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55362025-08-12T22:50:13.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 18643e86-2c70-44ba-8611-0af99128d366 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55372025-08-12T22:50:13.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 18643e86-2c70-44ba-8611-0af99128d366 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55382025-08-12T22:50:13.820ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:35072
55392025-08-12T22:50:13.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35072 req_id = b284b3a7-b4d2-48db-9278-d7080b3b2b02 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
55402025-08-12T22:50:13.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35072 req_id = b284b3a7-b4d2-48db-9278-d7080b3b2b02 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
55412025-08-12T22:50:13.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35072 req_id = b284b3a7-b4d2-48db-9278-d7080b3b2b02 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
55422025-08-12T22:50:13.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35072 req_id = 446ff2ac-0f66-4b6b-bc7a-63365c8c06f3 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
55432025-08-12T22:50:13.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35072 req_id = 446ff2ac-0f66-4b6b-bc7a-63365c8c06f3 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
55442025-08-12T22:50:13.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35072 req_id = 446ff2ac-0f66-4b6b-bc7a-63365c8c06f3 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
55452025-08-12T22:50:14.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 315bf638-1e9f-4769-9dd2-bec25f7f90f9 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55462025-08-12T22:50:14.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 315bf638-1e9f-4769-9dd2-bec25f7f90f9 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55472025-08-12T22:50:14.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 315bf638-1e9f-4769-9dd2-bec25f7f90f9 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55482025-08-12T22:50:15.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a3901920-e649-466b-8cd0-b73ee665efd3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55492025-08-12T22:50:15.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a3901920-e649-466b-8cd0-b73ee665efd3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55502025-08-12T22:50:15.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a3901920-e649-466b-8cd0-b73ee665efd3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55512025-08-12T22:50:16.046ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 84 reason = Timeout
55522025-08-12T22:50:16.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
55532025-08-12T22:50:16.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
55542025-08-12T22:50:16.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55552025-08-12T22:50:16.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
55562025-08-12T22:50:16.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
55572025-08-12T22:50:16.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
55582025-08-12T22:50:16.053ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
55592025-08-12T22:50:16.053ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.16959ms iteration = 84 status = {"chicken_switches_updated":false}
55602025-08-12T22:50:16.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6f282b43-3979-4edc-a45b-d8e1133531dd roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55612025-08-12T22:50:16.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6f282b43-3979-4edc-a45b-d8e1133531dd resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55622025-08-12T22:50:16.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6f282b43-3979-4edc-a45b-d8e1133531dd response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55632025-08-12T22:50:17.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 104577da-65fa-4e6b-b106-7189999f7bc3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55642025-08-12T22:50:17.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 104577da-65fa-4e6b-b106-7189999f7bc3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55652025-08-12T22:50:17.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 104577da-65fa-4e6b-b106-7189999f7bc3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55662025-08-12T22:50:18.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8834ad61-235b-42c4-83e3-f656ffdd97e7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55672025-08-12T22:50:18.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8834ad61-235b-42c4-83e3-f656ffdd97e7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55682025-08-12T22:50:18.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8834ad61-235b-42c4-83e3-f656ffdd97e7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55692025-08-12T22:50:18.834ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 576 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 4c1cf727-641b-4e06-900a-49ede4c4708e response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
55702025-08-12T22:50:19.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 28dc3d12-c978-4967-90fd-9584f5fd09ef roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55712025-08-12T22:50:19.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 28dc3d12-c978-4967-90fd-9584f5fd09ef resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55722025-08-12T22:50:19.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 28dc3d12-c978-4967-90fd-9584f5fd09ef response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55732025-08-12T22:50:20.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 16c20288-d821-4e6f-8a7d-c5ec377206cb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55742025-08-12T22:50:20.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 16c20288-d821-4e6f-8a7d-c5ec377206cb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55752025-08-12T22:50:20.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 16c20288-d821-4e6f-8a7d-c5ec377206cb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
55762025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
55772025-08-12T22:50:21.045ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0
55782025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 26.121\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0"}
55792025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
55802025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
55812025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
55822025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55832025-08-12T22:50:21.045ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-12 22:40:21.045788094 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
55842025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
55852025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
55862025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
55872025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
55882025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
55892025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55902025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
55912025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
55922025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55932025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
55942025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
55952025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55962025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55972025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
55982025-08-12T22:50:21.045ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
55992025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
56002025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
56012025-08-12T22:50:21.046ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
56022025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
56032025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56042025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
56052025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
56062025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
56072025-08-12T22:50:21.046ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
56082025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56092025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56102025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56112025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
56122025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
56132025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 11 reason = Timeout
56142025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
56152025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 10.82\u{b5}s iteration = 11 status = "Disabled"
56162025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
56172025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
56182025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 8 reason = Timeout
56192025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
56202025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 8 reason = Timeout
56212025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
56222025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 15 reason = Timeout
56232025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
56242025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
56252025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
56262025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
56272025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56282025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
56292025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56302025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
56312025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
56322025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 85 reason = Timeout
56332025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56342025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
56352025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56362025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
56372025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
56382025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56392025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56402025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
56412025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
56422025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
56432025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56442025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 15 reason = Timeout
56452025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
56462025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 12.111\u{b5}s iteration = 15 status = {"disabled":true,"errors":[],"sps":[]}
56472025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56482025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
56492025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
56502025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56512025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
56522025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
56532025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
56542025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56552025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56562025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56572025-08-12T22:50:21.046ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3e3264d-303d-4ce7-a0ce-0090b10b154f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1423, tv_nsec: 282495142 } })
56582025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56592025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56602025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
56612025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
56622025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
56632025-08-12T22:50:21.046ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("043b8097-0e38-4228-bada-dac70e518148.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26cd5275-57f5-4466-a94f-f96956f55588.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1423, tv_nsec: 282709234 } })
56642025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56652025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56662025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
56672025-08-12T22:50:21.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56682025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56692025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56702025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
56712025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
56722025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
56732025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56742025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56752025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56762025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56772025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
56782025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56792025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
56802025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56812025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56822025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
56832025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56842025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56852025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
56862025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.474664ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
56872025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56882025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
56892025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.599546ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
56902025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56912025-08-12T22:50:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56922025-08-12T22:50:21.048ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56932025-08-12T22:50:21.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56942025-08-12T22:50:21.048ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-12 22:40:21.045788094 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
56952025-08-12T22:50:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.0461ms iteration = 8 status = {"expiration":"2025-08-12T22:40:21.045788094Z","pruned":[]}
56962025-08-12T22:50:21.049ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1423, tv_nsec: 285445801 } })
56972025-08-12T22:50:21.049ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.417943ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
56982025-08-12T22:50:21.049ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
56992025-08-12T22:50:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57002025-08-12T22:50:21.051ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57012025-08-12T22:50:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57022025-08-12T22:50:21.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57032025-08-12T22:50:21.051ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57042025-08-12T22:50:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57052025-08-12T22:50:21.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57062025-08-12T22:50:21.054ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.356342ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57072025-08-12T22:50:21.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57082025-08-12T22:50:21.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57092025-08-12T22:50:21.057ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57102025-08-12T22:50:21.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57112025-08-12T22:50:21.057ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1423, tv_nsec: 293472610 } })
57122025-08-12T22:50:21.057ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
57132025-08-12T22:50:21.057ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 11.568344ms iteration = 8 status = {"by_rx":{},"error":null}
57142025-08-12T22:50:21.058ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
57152025-08-12T22:50:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57162025-08-12T22:50:21.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57172025-08-12T22:50:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57182025-08-12T22:50:21.058ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57192025-08-12T22:50:21.059ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 13.672794ms iteration = 15 status = {"errors":[],"requests_created_ok":[]}
57202025-08-12T22:50:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57212025-08-12T22:50:21.061ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
57222025-08-12T22:50:21.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57232025-08-12T22:50:21.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57242025-08-12T22:50:21.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57252025-08-12T22:50:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
57262025-08-12T22:50:21.061ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57272025-08-12T22:50:21.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57282025-08-12T22:50:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57292025-08-12T22:50:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
57302025-08-12T22:50:21.061ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57312025-08-12T22:50:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57322025-08-12T22:50:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57332025-08-12T22:50:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57342025-08-12T22:50:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57352025-08-12T22:50:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57362025-08-12T22:50:21.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57372025-08-12T22:50:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57382025-08-12T22:50:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
57392025-08-12T22:50:21.063ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57402025-08-12T22:50:21.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57412025-08-12T22:50:21.063ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57422025-08-12T22:50:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57432025-08-12T22:50:21.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 17.240419ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57442025-08-12T22:50:21.064ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 18.238358ms iteration = 8 status = {"dispatched":[],"errors":[],"glob_version":"180.0.0","globs_reprocessed":{},"no_receivers":[]}
57452025-08-12T22:50:21.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57462025-08-12T22:50:21.066ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57472025-08-12T22:50:21.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57482025-08-12T22:50:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57492025-08-12T22:50:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
57502025-08-12T22:50:21.067ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57512025-08-12T22:50:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57522025-08-12T22:50:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57532025-08-12T22:50:21.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57542025-08-12T22:50:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57552025-08-12T22:50:21.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57562025-08-12T22:50:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57572025-08-12T22:50:21.108ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57582025-08-12T22:50:21.110ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57592025-08-12T22:50:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57602025-08-12T22:50:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
57612025-08-12T22:50:21.113ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
57622025-08-12T22:50:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
57632025-08-12T22:50:21.115ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57642025-08-12T22:50:21.115ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57652025-08-12T22:50:21.115ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57662025-08-12T22:50:21.115ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57672025-08-12T22:50:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57682025-08-12T22:50:21.117ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57692025-08-12T22:50:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57702025-08-12T22:50:21.118ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57712025-08-12T22:50:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57722025-08-12T22:50:21.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57732025-08-12T22:50:21.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 74.302749ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
57742025-08-12T22:50:21.120ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
57752025-08-12T22:50:21.120ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 74.266549ms iteration = 85 status = {"chicken_switches_updated":false}
57762025-08-12T22:50:21.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57772025-08-12T22:50:21.121ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57782025-08-12T22:50:21.121ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57792025-08-12T22:50:21.121ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57802025-08-12T22:50:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57812025-08-12T22:50:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57822025-08-12T22:50:21.122ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57832025-08-12T22:50:21.122ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
57842025-08-12T22:50:21.122ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
57852025-08-12T22:50:21.122ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
57862025-08-12T22:50:21.122ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57872025-08-12T22:50:21.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.203607ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
57882025-08-12T22:50:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57892025-08-12T22:50:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57902025-08-12T22:50:21.125ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57912025-08-12T22:50:21.125ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1423, tv_nsec: 361296485 } })
57922025-08-12T22:50:21.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57932025-08-12T22:50:21.125ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
57942025-08-12T22:50:21.126ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 80.142526ms iteration = 17 status = {"physical_disks_added":0}
57952025-08-12T22:50:21.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57962025-08-12T22:50:21.127ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.241877ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57972025-08-12T22:50:21.128ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
57982025-08-12T22:50:21.128ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
57992025-08-12T22:50:21.128ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
58002025-08-12T22:50:21.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58012025-08-12T22:50:21.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58022025-08-12T22:50:21.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58032025-08-12T22:50:21.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58042025-08-12T22:50:21.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58052025-08-12T22:50:21.129ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
58062025-08-12T22:50:21.129ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
58072025-08-12T22:50:21.129ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.816172ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
58082025-08-12T22:50:21.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58092025-08-12T22:50:21.130ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58102025-08-12T22:50:21.130ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.219356ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58112025-08-12T22:50:21.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58122025-08-12T22:50:21.131ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58132025-08-12T22:50:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58142025-08-12T22:50:21.133ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58152025-08-12T22:50:21.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58162025-08-12T22:50:21.134ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58172025-08-12T22:50:21.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58182025-08-12T22:50:21.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58192025-08-12T22:50:21.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58202025-08-12T22:50:21.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58212025-08-12T22:50:21.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
58222025-08-12T22:50:21.135ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58232025-08-12T22:50:21.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58242025-08-12T22:50:21.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58252025-08-12T22:50:21.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58262025-08-12T22:50:21.137ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
58272025-08-12T22:50:21.137ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 91.211755ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
58282025-08-12T22:50:21.141ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
58292025-08-12T22:50:21.141ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
58302025-08-12T22:50:21.141ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 95.490707ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
58312025-08-12T22:50:21.166ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58322025-08-12T22:50:21.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58332025-08-12T22:50:21.168ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58342025-08-12T22:50:21.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.235859ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58352025-08-12T22:50:21.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 123.650693ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
58362025-08-12T22:50:21.170ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58372025-08-12T22:50:21.170ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58382025-08-12T22:50:21.170ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.016806ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58392025-08-12T22:50:21.170ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58402025-08-12T22:50:21.170ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58412025-08-12T22:50:21.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58422025-08-12T22:50:21.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58432025-08-12T22:50:21.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
58442025-08-12T22:50:21.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58452025-08-12T22:50:21.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58462025-08-12T22:50:21.180ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
58472025-08-12T22:50:21.180ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
58482025-08-12T22:50:21.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58492025-08-12T22:50:21.180ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
58502025-08-12T22:50:21.180ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 0 version = 2
58512025-08-12T22:50:21.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58522025-08-12T22:50:21.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58532025-08-12T22:50:21.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58542025-08-12T22:50:21.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58552025-08-12T22:50:21.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58562025-08-12T22:50:21.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58572025-08-12T22:50:21.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58582025-08-12T22:50:21.185ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58592025-08-12T22:50:21.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58602025-08-12T22:50:21.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58612025-08-12T22:50:21.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58622025-08-12T22:50:21.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58632025-08-12T22:50:21.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58642025-08-12T22:50:21.187ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
58652025-08-12T22:50:21.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58662025-08-12T22:50:21.187ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58672025-08-12T22:50:21.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58682025-08-12T22:50:21.188ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 4 version = 2
58692025-08-12T22:50:21.188ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
58702025-08-12T22:50:21.188ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-12 22:43:50.527483 UTC dns_group = external generation = 2
58712025-08-12T22:50:21.188ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 142.78636ms iteration = 8 status = {"generation":2}
58722025-08-12T22:50:21.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
58732025-08-12T22:50:21.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58742025-08-12T22:50:21.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58752025-08-12T22:50:21.189ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
58762025-08-12T22:50:21.189ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
58772025-08-12T22:50:21.189ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-12 22:43:49.909589 UTC dns_group = internal generation = 1
58782025-08-12T22:50:21.189ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 144.047433ms iteration = 8 status = {"generation":1}
58792025-08-12T22:50:21.191ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 145.415806ms iteration = 15 status = 0
58802025-08-12T22:50:21.194ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
58812025-08-12T22:50:21.194ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 147.546407ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
58822025-08-12T22:50:21.194ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
58832025-08-12T22:50:21.204ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
58842025-08-12T22:50:21.204ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58852025-08-12T22:50:21.204ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c6420b6-ca5c-458d-888d-c0e8e4875ad4", "content-length": "26", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} })
58862025-08-12T22:50:21.205ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58872025-08-12T22:50:21.206ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58882025-08-12T22:50:21.208ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58892025-08-12T22:50:21.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58902025-08-12T22:50:21.217ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58912025-08-12T22:50:21.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58922025-08-12T22:50:21.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c045af28-b073-4bde-a512-180501f7a927 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
58932025-08-12T22:50:21.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c045af28-b073-4bde-a512-180501f7a927 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
58942025-08-12T22:50:21.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c045af28-b073-4bde-a512-180501f7a927 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
58952025-08-12T22:50:21.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58962025-08-12T22:50:21.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58972025-08-12T22:50:21.226ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-12T22:43:09.981233Z, time_modified: 2025-08-12T22:43:09.981233Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }) }
58982025-08-12T22:50:21.226ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 181.036815ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]}},"default_endpoint":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
58992025-08-12T22:50:21.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59002025-08-12T22:50:21.228ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59012025-08-12T22:50:21.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59022025-08-12T22:50:21.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59032025-08-12T22:50:21.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59042025-08-12T22:50:21.232ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59052025-08-12T22:50:21.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59062025-08-12T22:50:21.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59072025-08-12T22:50:21.293ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
59082025-08-12T22:50:21.293ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59092025-08-12T22:50:21.293ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e33f7d2-d422-4cf1-b5f6-717880c33d08", "content-length": "26", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} })
59102025-08-12T22:50:21.293ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59112025-08-12T22:50:21.295ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59122025-08-12T22:50:21.317ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
59132025-08-12T22:50:21.317ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 270.985228ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
59142025-08-12T22:50:21.365ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
59152025-08-12T22:50:21.365ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ed877155-7263-40dc-8251-57dd245c07b6", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59162025-08-12T22:50:21.365ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59172025-08-12T22:50:21.368ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a1327eb2-9442-4689-953e-b55a5c02690a", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59182025-08-12T22:50:21.368ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59192025-08-12T22:50:21.371ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59202025-08-12T22:50:21.371ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 325.3436ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
59212025-08-12T22:50:21.430ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59222025-08-12T22:50:21.431ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a5f7765-8d46-4413-870d-aba1db1cc8e6", "content-length": "691", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} })
59232025-08-12T22:50:21.431ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59242025-08-12T22:50:21.431ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59252025-08-12T22:50:21.431ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
59262025-08-12T22:50:21.432ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 386.367569ms iteration = 15 status = {}
59272025-08-12T22:50:21.443ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59282025-08-12T22:50:21.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59292025-08-12T22:50:21.445ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 399.853272ms iteration = 15 status = null
59302025-08-12T22:50:21.452ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
59312025-08-12T22:50:21.452ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59322025-08-12T22:50:21.453ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "180345cb-2285-4f79-85b3-09f34b2aa8e1", "content-length": "26", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} })
59332025-08-12T22:50:21.453ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59342025-08-12T22:50:21.454ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
59352025-08-12T22:50:21.519ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 473.343452ms iteration = 15 status = {}
59362025-08-12T22:50:21.522ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59372025-08-12T22:50:21.522ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59382025-08-12T22:50:21.522ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b635543e-c23e-46e8-8fc1-e1ce4aad8331", "content-length": "372", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} })
59392025-08-12T22:50:21.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59402025-08-12T22:50:21.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59412025-08-12T22:50:21.525ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
59422025-08-12T22:50:21.538ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
59432025-08-12T22:50:21.538ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59442025-08-12T22:50:21.538ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "40c121af-58dd-4ab4-a0c2-ad084ba698ba", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} })
59452025-08-12T22:50:21.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59462025-08-12T22:50:21.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59472025-08-12T22:50:21.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59482025-08-12T22:50:21.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59492025-08-12T22:50:21.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59502025-08-12T22:50:21.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59512025-08-12T22:50:21.547ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59522025-08-12T22:50:21.547ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59532025-08-12T22:50:21.548ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bb21eb87-1bd6-4130-9802-3d751f6a23c6", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} })
59542025-08-12T22:50:21.550ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 504.435737ms iteration = 15 status = {}
59552025-08-12T22:50:21.586ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
59562025-08-12T22:50:21.587ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0b98df09-294a-48cd-95f6-1af65347eb13", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59572025-08-12T22:50:21.587ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59582025-08-12T22:50:21.589ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "aef560bf-e8ed-4220-a5cb-dac9c0e6bbc0", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59592025-08-12T22:50:21.589ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59602025-08-12T22:50:21.591ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1e2b6e22-a292-4b11-a993-4de458d0c504", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59612025-08-12T22:50:21.591ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59622025-08-12T22:50:21.593ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59632025-08-12T22:50:21.593ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 547.417158ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
59642025-08-12T22:50:21.637ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59652025-08-12T22:50:21.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59662025-08-12T22:50:21.639ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
59672025-08-12T22:50:21.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59682025-08-12T22:50:21.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59692025-08-12T22:50:21.650ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
59702025-08-12T22:50:21.650ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
59712025-08-12T22:50:21.651ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
59722025-08-12T22:50:21.651ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59732025-08-12T22:50:21.651ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59742025-08-12T22:50:21.651ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59752025-08-12T22:50:21.651ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59762025-08-12T22:50:21.651ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59772025-08-12T22:50:21.651ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59782025-08-12T22:50:21.651ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59792025-08-12T22:50:21.651ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
59802025-08-12T22:50:21.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59812025-08-12T22:50:21.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59822025-08-12T22:50:21.653ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
59832025-08-12T22:50:21.653ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59842025-08-12T22:50:21.770ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "daee67e7-645f-498a-b4ea-5860bc00221c", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} })
59852025-08-12T22:50:21.770ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
59862025-08-12T22:50:21.770ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59872025-08-12T22:50:21.771ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a61305aa-fa3e-441f-bc2a-c70a4343f58a", "content-length": "682", "date": "Tue, 12 Aug 2025 22:50:21 GMT"} })
59882025-08-12T22:50:21.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59892025-08-12T22:50:21.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59902025-08-12T22:50:21.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59912025-08-12T22:50:21.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59922025-08-12T22:50:21.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59932025-08-12T22:50:21.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59942025-08-12T22:50:21.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59952025-08-12T22:50:21.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59962025-08-12T22:50:21.787ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 741.438711ms iteration = 15 status = {}
59972025-08-12T22:50:22.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d060be9d-0d8e-428e-8e4e-0b40036abf9f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
59982025-08-12T22:50:22.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d060be9d-0d8e-428e-8e4e-0b40036abf9f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
59992025-08-12T22:50:22.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d060be9d-0d8e-428e-8e4e-0b40036abf9f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60002025-08-12T22:50:23.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9d4edfcd-5022-4f45-aea9-b9c643481e51 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60012025-08-12T22:50:23.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9d4edfcd-5022-4f45-aea9-b9c643481e51 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60022025-08-12T22:50:23.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9d4edfcd-5022-4f45-aea9-b9c643481e51 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60032025-08-12T22:50:24.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 46c1fa65-ea72-4478-873b-0865de4c18ac roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60042025-08-12T22:50:24.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 46c1fa65-ea72-4478-873b-0865de4c18ac resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60052025-08-12T22:50:24.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 46c1fa65-ea72-4478-873b-0865de4c18ac response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60062025-08-12T22:50:25.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 488960e5-8973-4cb4-aa29-7e24dd57ffe5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60072025-08-12T22:50:25.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 488960e5-8973-4cb4-aa29-7e24dd57ffe5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60082025-08-12T22:50:25.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 488960e5-8973-4cb4-aa29-7e24dd57ffe5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60092025-08-12T22:50:26.046ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 86 reason = Timeout
60102025-08-12T22:50:26.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
60112025-08-12T22:50:26.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
60122025-08-12T22:50:26.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60132025-08-12T22:50:26.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
60142025-08-12T22:50:26.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
60152025-08-12T22:50:26.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
60162025-08-12T22:50:26.053ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
60172025-08-12T22:50:26.053ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.03258ms iteration = 86 status = {"chicken_switches_updated":false}
60182025-08-12T22:50:26.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8906425d-25e8-47c7-a10a-dcfc9aec2467 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60192025-08-12T22:50:26.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8906425d-25e8-47c7-a10a-dcfc9aec2467 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60202025-08-12T22:50:26.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8906425d-25e8-47c7-a10a-dcfc9aec2467 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60212025-08-12T22:50:27.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = af43b8e8-c64e-4a77-b9ad-7c6fd1cd0506 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60222025-08-12T22:50:27.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = af43b8e8-c64e-4a77-b9ad-7c6fd1cd0506 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60232025-08-12T22:50:27.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = af43b8e8-c64e-4a77-b9ad-7c6fd1cd0506 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60242025-08-12T22:50:28.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6e05f69f-2660-4645-b274-7b6131cacdbe roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60252025-08-12T22:50:28.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6e05f69f-2660-4645-b274-7b6131cacdbe resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60262025-08-12T22:50:28.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6e05f69f-2660-4645-b274-7b6131cacdbe response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60272025-08-12T22:50:28.833ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 521 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = c505204f-f19f-4798-a977-65f47feb988d response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
60282025-08-12T22:50:29.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 86f05d25-f1ef-4cec-aae2-119ab98d40d6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60292025-08-12T22:50:29.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 86f05d25-f1ef-4cec-aae2-119ab98d40d6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60302025-08-12T22:50:29.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 86f05d25-f1ef-4cec-aae2-119ab98d40d6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60312025-08-12T22:50:30.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b57f6824-200d-44d8-930f-f741203a04e6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60322025-08-12T22:50:30.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b57f6824-200d-44d8-930f-f741203a04e6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60332025-08-12T22:50:30.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b57f6824-200d-44d8-930f-f741203a04e6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60342025-08-12T22:50:31.046ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
60352025-08-12T22:50:31.046ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60362025-08-12T22:50:31.046ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
60372025-08-12T22:50:31.047ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 87 reason = Timeout
60382025-08-12T22:50:31.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60392025-08-12T22:50:31.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
60402025-08-12T22:50:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60412025-08-12T22:50:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
60422025-08-12T22:50:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60432025-08-12T22:50:31.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60442025-08-12T22:50:31.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60452025-08-12T22:50:31.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60462025-08-12T22:50:31.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60472025-08-12T22:50:31.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.207821ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60482025-08-12T22:50:31.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60492025-08-12T22:50:31.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60502025-08-12T22:50:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
60512025-08-12T22:50:31.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
60522025-08-12T22:50:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60532025-08-12T22:50:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
60542025-08-12T22:50:31.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
60552025-08-12T22:50:31.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.411163ms iteration = 87 status = {"chicken_switches_updated":false}
60562025-08-12T22:50:31.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60572025-08-12T22:50:31.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60582025-08-12T22:50:31.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60592025-08-12T22:50:31.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
60602025-08-12T22:50:31.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60612025-08-12T22:50:31.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60622025-08-12T22:50:31.075ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
60632025-08-12T22:50:31.076ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.071945ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
60642025-08-12T22:50:31.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 71804271-179b-4b51-abbf-4b7cc5012791 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60652025-08-12T22:50:31.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 71804271-179b-4b51-abbf-4b7cc5012791 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60662025-08-12T22:50:31.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 71804271-179b-4b51-abbf-4b7cc5012791 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60672025-08-12T22:50:32.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e964b69b-8393-45c5-8347-efbabc8d6754 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60682025-08-12T22:50:32.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e964b69b-8393-45c5-8347-efbabc8d6754 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60692025-08-12T22:50:32.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e964b69b-8393-45c5-8347-efbabc8d6754 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60702025-08-12T22:50:33.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cab1424d-add6-4416-a048-205fbf34de34 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60712025-08-12T22:50:33.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cab1424d-add6-4416-a048-205fbf34de34 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60722025-08-12T22:50:33.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cab1424d-add6-4416-a048-205fbf34de34 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60732025-08-12T22:50:34.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 31789674-1f5e-4b45-b879-6ca275e639ad roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60742025-08-12T22:50:34.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 31789674-1f5e-4b45-b879-6ca275e639ad resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60752025-08-12T22:50:34.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 31789674-1f5e-4b45-b879-6ca275e639ad response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60762025-08-12T22:50:35.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f331164e-3581-4fd4-ae1c-f90046228d9b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60772025-08-12T22:50:35.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f331164e-3581-4fd4-ae1c-f90046228d9b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60782025-08-12T22:50:35.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f331164e-3581-4fd4-ae1c-f90046228d9b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60792025-08-12T22:50:36.046ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 88 reason = Timeout
60802025-08-12T22:50:36.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
60812025-08-12T22:50:36.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
60822025-08-12T22:50:36.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60832025-08-12T22:50:36.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
60842025-08-12T22:50:36.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
60852025-08-12T22:50:36.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
60862025-08-12T22:50:36.053ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
60872025-08-12T22:50:36.053ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.861067ms iteration = 88 status = {"chicken_switches_updated":false}
60882025-08-12T22:50:36.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e48a42e6-463f-41bc-adc1-2793bf206c32 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60892025-08-12T22:50:36.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e48a42e6-463f-41bc-adc1-2793bf206c32 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60902025-08-12T22:50:36.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e48a42e6-463f-41bc-adc1-2793bf206c32 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60912025-08-12T22:50:37.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fadb518c-661c-4b66-b0ee-bd316b84dc3c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60922025-08-12T22:50:37.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fadb518c-661c-4b66-b0ee-bd316b84dc3c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60932025-08-12T22:50:37.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fadb518c-661c-4b66-b0ee-bd316b84dc3c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60942025-08-12T22:50:38.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 265cbf8e-3744-4326-bcf7-81b68ec5ecfe roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60952025-08-12T22:50:38.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 265cbf8e-3744-4326-bcf7-81b68ec5ecfe resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60962025-08-12T22:50:38.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 265cbf8e-3744-4326-bcf7-81b68ec5ecfe response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60972025-08-12T22:50:38.834ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 497 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = f0d6d857-c9df-44b4-baf2-7c0badd49d5a response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
60982025-08-12T22:50:39.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3299c35e-5c19-4135-bb8a-3d043a10be56 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
60992025-08-12T22:50:39.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3299c35e-5c19-4135-bb8a-3d043a10be56 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61002025-08-12T22:50:39.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3299c35e-5c19-4135-bb8a-3d043a10be56 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61012025-08-12T22:50:40.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a5caa267-6e37-4501-9870-38fb646072a2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61022025-08-12T22:50:40.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a5caa267-6e37-4501-9870-38fb646072a2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61032025-08-12T22:50:40.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a5caa267-6e37-4501-9870-38fb646072a2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61042025-08-12T22:50:41.046ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
61052025-08-12T22:50:41.046ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61062025-08-12T22:50:41.046ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
61072025-08-12T22:50:41.046ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 89 reason = Timeout
61082025-08-12T22:50:41.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61092025-08-12T22:50:41.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
61102025-08-12T22:50:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
61112025-08-12T22:50:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61122025-08-12T22:50:41.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61132025-08-12T22:50:41.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61142025-08-12T22:50:41.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61152025-08-12T22:50:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61162025-08-12T22:50:41.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61172025-08-12T22:50:41.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.739787ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61182025-08-12T22:50:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61192025-08-12T22:50:41.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61202025-08-12T22:50:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61212025-08-12T22:50:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
61222025-08-12T22:50:41.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
61232025-08-12T22:50:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
61242025-08-12T22:50:41.054ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
61252025-08-12T22:50:41.054ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.905607ms iteration = 89 status = {"chicken_switches_updated":false}
61262025-08-12T22:50:41.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61272025-08-12T22:50:41.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61282025-08-12T22:50:41.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61292025-08-12T22:50:41.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
61302025-08-12T22:50:41.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61312025-08-12T22:50:41.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61322025-08-12T22:50:41.071ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
61332025-08-12T22:50:41.071ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.890274ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
61342025-08-12T22:50:41.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f792bc40-f454-408d-8b96-74f0a43f1429 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61352025-08-12T22:50:41.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f792bc40-f454-408d-8b96-74f0a43f1429 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61362025-08-12T22:50:41.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f792bc40-f454-408d-8b96-74f0a43f1429 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61372025-08-12T22:50:42.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a7fca978-63fe-4d1c-90a2-d9c0f6308317 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61382025-08-12T22:50:42.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a7fca978-63fe-4d1c-90a2-d9c0f6308317 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61392025-08-12T22:50:42.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a7fca978-63fe-4d1c-90a2-d9c0f6308317 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61402025-08-12T22:50:43.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9caed989-189a-4cff-9a0d-ebe1ec02279e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61412025-08-12T22:50:43.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9caed989-189a-4cff-9a0d-ebe1ec02279e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61422025-08-12T22:50:43.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9caed989-189a-4cff-9a0d-ebe1ec02279e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61432025-08-12T22:50:44.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 542d8726-819b-4859-9b30-ba1c355a03a4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61442025-08-12T22:50:44.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 542d8726-819b-4859-9b30-ba1c355a03a4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61452025-08-12T22:50:44.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 542d8726-819b-4859-9b30-ba1c355a03a4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61462025-08-12T22:50:45.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 905ba48f-f232-4e01-988c-6c0e49cfa6a2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61472025-08-12T22:50:45.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 905ba48f-f232-4e01-988c-6c0e49cfa6a2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61482025-08-12T22:50:45.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 905ba48f-f232-4e01-988c-6c0e49cfa6a2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61492025-08-12T22:50:46.047ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 90 reason = Timeout
61502025-08-12T22:50:46.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
61512025-08-12T22:50:46.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
61522025-08-12T22:50:46.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61532025-08-12T22:50:46.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
61542025-08-12T22:50:46.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
61552025-08-12T22:50:46.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
61562025-08-12T22:50:46.053ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
61572025-08-12T22:50:46.053ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.603074ms iteration = 90 status = {"chicken_switches_updated":false}
61582025-08-12T22:50:46.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bad784b4-47a7-437c-86c9-f6e0fc1bf486 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61592025-08-12T22:50:46.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bad784b4-47a7-437c-86c9-f6e0fc1bf486 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61602025-08-12T22:50:46.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bad784b4-47a7-437c-86c9-f6e0fc1bf486 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61612025-08-12T22:50:47.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ca38be2b-111c-45ec-bf74-69be8846e528 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61622025-08-12T22:50:47.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ca38be2b-111c-45ec-bf74-69be8846e528 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61632025-08-12T22:50:47.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ca38be2b-111c-45ec-bf74-69be8846e528 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61642025-08-12T22:50:48.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 780e9eb4-82ad-480a-a25b-f4f95db77e96 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61652025-08-12T22:50:48.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 780e9eb4-82ad-480a-a25b-f4f95db77e96 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61662025-08-12T22:50:48.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2688 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 780e9eb4-82ad-480a-a25b-f4f95db77e96 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61672025-08-12T22:50:48.835ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 564 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = d57a7be5-c7b7-4208-af3c-f8a1ede71917 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
61682025-08-12T22:50:49.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 229c4aea-f815-4680-a957-30b743de1f6b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61692025-08-12T22:50:49.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 229c4aea-f815-4680-a957-30b743de1f6b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61702025-08-12T22:50:49.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 229c4aea-f815-4680-a957-30b743de1f6b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61712025-08-12T22:50:50.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 54122e2b-2152-4539-be03-110fa9af4bf9 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61722025-08-12T22:50:50.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 54122e2b-2152-4539-be03-110fa9af4bf9 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61732025-08-12T22:50:50.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 54122e2b-2152-4539-be03-110fa9af4bf9 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
61742025-08-12T22:50:51.045ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
61752025-08-12T22:50:51.045ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
61762025-08-12T22:50:51.045ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61772025-08-12T22:50:51.045ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
61782025-08-12T22:50:51.045ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61792025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61802025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61812025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 16 reason = Timeout
61822025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
61832025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 14.98\u{b5}s iteration = 16 status = {"disabled":true,"errors":[],"sps":[]}
61842025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
61852025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61862025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
61872025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61882025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61892025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
61902025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61912025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61922025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
61932025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
61942025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61952025-08-12T22:50:51.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61962025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
61972025-08-12T22:50:51.047ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61982025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 16 reason = Timeout
61992025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62002025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
62012025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
62022025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
62032025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62042025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
62052025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62062025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62072025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 91 reason = Timeout
62082025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
62092025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
62102025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62112025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
62122025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62132025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
62142025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62152025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
62162025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62172025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
62182025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62192025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62202025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62212025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62222025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62232025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62242025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62252025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62262025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62272025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62282025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
62292025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62302025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62312025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62322025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62332025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62342025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62352025-08-12T22:50:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
62362025-08-12T22:50:51.048ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1453, tv_nsec: 284222416 } })
62372025-08-12T22:50:51.048ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1453, tv_nsec: 284235056 } })
62382025-08-12T22:50:51.049ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
62392025-08-12T22:50:51.049ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
62402025-08-12T22:50:51.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.676546ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
62412025-08-12T22:50:51.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62422025-08-12T22:50:51.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62432025-08-12T22:50:51.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62442025-08-12T22:50:51.055ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.889457ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62452025-08-12T22:50:51.055ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62462025-08-12T22:50:51.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62472025-08-12T22:50:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62482025-08-12T22:50:51.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62492025-08-12T22:50:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62502025-08-12T22:50:51.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62512025-08-12T22:50:51.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62522025-08-12T22:50:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
62532025-08-12T22:50:51.059ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
62542025-08-12T22:50:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
62552025-08-12T22:50:51.059ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62562025-08-12T22:50:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62572025-08-12T22:50:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
62582025-08-12T22:50:51.059ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 12.787635ms iteration = 16 status = {"errors":[],"requests_created_ok":[]}
62592025-08-12T22:50:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62602025-08-12T22:50:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62612025-08-12T22:50:51.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62622025-08-12T22:50:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62632025-08-12T22:50:51.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62642025-08-12T22:50:51.062ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
62652025-08-12T22:50:51.062ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 15.047287ms iteration = 91 status = {"chicken_switches_updated":false}
62662025-08-12T22:50:51.062ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1453, tv_nsec: 297366175 } })
62672025-08-12T22:50:51.062ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
62682025-08-12T22:50:51.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62692025-08-12T22:50:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62702025-08-12T22:50:51.063ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62712025-08-12T22:50:51.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62722025-08-12T22:50:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62732025-08-12T22:50:51.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62742025-08-12T22:50:51.104ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62752025-08-12T22:50:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62762025-08-12T22:50:51.105ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.134541ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
62772025-08-12T22:50:51.106ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62782025-08-12T22:50:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62792025-08-12T22:50:51.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62802025-08-12T22:50:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62812025-08-12T22:50:51.107ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62822025-08-12T22:50:51.107ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62832025-08-12T22:50:51.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62842025-08-12T22:50:51.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62852025-08-12T22:50:51.107ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62862025-08-12T22:50:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62872025-08-12T22:50:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62882025-08-12T22:50:51.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62892025-08-12T22:50:51.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62902025-08-12T22:50:51.108ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62912025-08-12T22:50:51.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62922025-08-12T22:50:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
62932025-08-12T22:50:51.109ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62942025-08-12T22:50:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62952025-08-12T22:50:51.109ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62962025-08-12T22:50:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62972025-08-12T22:50:51.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62982025-08-12T22:50:51.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62992025-08-12T22:50:51.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63002025-08-12T22:50:51.111ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63012025-08-12T22:50:51.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63022025-08-12T22:50:51.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63032025-08-12T22:50:51.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63042025-08-12T22:50:51.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63052025-08-12T22:50:51.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63062025-08-12T22:50:51.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63072025-08-12T22:50:51.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63082025-08-12T22:50:51.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63092025-08-12T22:50:51.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
63102025-08-12T22:50:51.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63112025-08-12T22:50:51.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63122025-08-12T22:50:51.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63132025-08-12T22:50:51.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63142025-08-12T22:50:51.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63152025-08-12T22:50:51.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63162025-08-12T22:50:51.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63172025-08-12T22:50:51.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
63182025-08-12T22:50:51.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63192025-08-12T22:50:51.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63202025-08-12T22:50:51.135ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.452098ms iteration = 16 status = 0
63212025-08-12T22:50:51.144ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
63222025-08-12T22:50:51.144ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.81532ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
63232025-08-12T22:50:51.151ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
63242025-08-12T22:50:51.151ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63252025-08-12T22:50:51.151ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7354a32-0fac-4123-80e6-f0f31f2aa5d0", "content-length": "26", "date": "Tue, 12 Aug 2025 22:50:51 GMT"} })
63262025-08-12T22:50:51.151ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63272025-08-12T22:50:51.153ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63282025-08-12T22:50:51.156ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 109.561885ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63292025-08-12T22:50:51.160ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63302025-08-12T22:50:51.160ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.233371ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63312025-08-12T22:50:51.160ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63322025-08-12T22:50:51.160ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63332025-08-12T22:50:51.160ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63342025-08-12T22:50:51.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63352025-08-12T22:50:51.160ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
63362025-08-12T22:50:51.160ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63372025-08-12T22:50:51.160ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
63382025-08-12T22:50:51.160ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63392025-08-12T22:50:51.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63402025-08-12T22:50:51.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63412025-08-12T22:50:51.160ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d46dd6aa-014b-4966-9f2e-d80f19bcad2b", "content-length": "26", "date": "Tue, 12 Aug 2025 22:50:51 GMT"} })
63422025-08-12T22:50:51.160ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66efe6bb-afec-450b-ac56-2f95a05a4aec", "content-length": "26", "date": "Tue, 12 Aug 2025 22:50:51 GMT"} })
63432025-08-12T22:50:51.160ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63442025-08-12T22:50:51.160ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63452025-08-12T22:50:51.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 114.374792ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63462025-08-12T22:50:51.162ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63472025-08-12T22:50:51.163ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
63482025-08-12T22:50:51.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.048187ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63492025-08-12T22:50:51.167ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
63502025-08-12T22:50:51.167ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 120.027368ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
63512025-08-12T22:50:51.168ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63522025-08-12T22:50:51.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63532025-08-12T22:50:51.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63542025-08-12T22:50:51.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63552025-08-12T22:50:51.196ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63562025-08-12T22:50:51.196ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63572025-08-12T22:50:51.196ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 150.019162ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63582025-08-12T22:50:51.196ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 150.094622ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
63592025-08-12T22:50:51.200ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63602025-08-12T22:50:51.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63612025-08-12T22:50:51.248ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63622025-08-12T22:50:51.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63632025-08-12T22:50:51.250ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63642025-08-12T22:50:51.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63652025-08-12T22:50:51.252ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63662025-08-12T22:50:51.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63672025-08-12T22:50:51.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63682025-08-12T22:50:51.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63692025-08-12T22:50:51.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63702025-08-12T22:50:51.256ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 210.290003ms iteration = 16 status = {}
63712025-08-12T22:50:51.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63722025-08-12T22:50:51.268ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63732025-08-12T22:50:51.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63742025-08-12T22:50:51.269ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 224.208039ms iteration = 16 status = null
63752025-08-12T22:50:51.274ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63762025-08-12T22:50:51.274ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63772025-08-12T22:50:51.274ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "51610936-3cfe-4a00-bf73-e3bf245fc095", "content-length": "372", "date": "Tue, 12 Aug 2025 22:50:51 GMT"} })
63782025-08-12T22:50:51.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63792025-08-12T22:50:51.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63802025-08-12T22:50:51.288ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 241.167935ms iteration = 18 status = {"physical_disks_added":0}
63812025-08-12T22:50:51.336ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
63822025-08-12T22:50:51.336ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
63832025-08-12T22:50:51.336ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b9ea6000-c073-4335-83e1-ddd7d32b7ad3", "date": "Tue, 12 Aug 2025 22:50:51 GMT"} })
63842025-08-12T22:50:51.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63852025-08-12T22:50:51.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63862025-08-12T22:50:51.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63872025-08-12T22:50:51.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63882025-08-12T22:50:51.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63892025-08-12T22:50:51.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63902025-08-12T22:50:51.346ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
63912025-08-12T22:50:51.346ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63922025-08-12T22:50:51.346ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "82345353-b20d-49ab-9036-1bd348fabf07", "date": "Tue, 12 Aug 2025 22:50:51 GMT"} })
63932025-08-12T22:50:51.348ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 301.618748ms iteration = 16 status = {}
63942025-08-12T22:50:51.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63952025-08-12T22:50:51.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63962025-08-12T22:50:51.352ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
63972025-08-12T22:50:51.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63982025-08-12T22:50:51.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63992025-08-12T22:50:51.367ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
64002025-08-12T22:50:51.367ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
64012025-08-12T22:50:51.368ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64022025-08-12T22:50:51.368ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64032025-08-12T22:50:51.368ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64042025-08-12T22:50:51.368ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64052025-08-12T22:50:51.368ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64062025-08-12T22:50:51.368ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64072025-08-12T22:50:51.368ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64082025-08-12T22:50:51.368ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64092025-08-12T22:50:51.369ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
64102025-08-12T22:50:51.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64112025-08-12T22:50:51.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64122025-08-12T22:50:51.372ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
64132025-08-12T22:50:51.372ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64142025-08-12T22:50:51.379ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64152025-08-12T22:50:51.380ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "be0a4240-a406-4206-a45a-0678baae23ac", "content-length": "691", "date": "Tue, 12 Aug 2025 22:50:51 GMT"} })
64162025-08-12T22:50:51.380ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
64172025-08-12T22:50:51.380ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
64182025-08-12T22:50:51.380ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
64192025-08-12T22:50:51.382ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 335.47884ms iteration = 16 status = {}
64202025-08-12T22:50:51.497ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "74de3029-c662-4926-84c1-64d5233d44e3", "date": "Tue, 12 Aug 2025 22:50:51 GMT"} })
64212025-08-12T22:50:51.497ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
64222025-08-12T22:50:51.497ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64232025-08-12T22:50:51.497ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8e80fb2-8e2c-40af-8f98-997759992aa5", "content-length": "682", "date": "Tue, 12 Aug 2025 22:50:51 GMT"} })
64242025-08-12T22:50:51.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64252025-08-12T22:50:51.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64262025-08-12T22:50:51.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64272025-08-12T22:50:51.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64282025-08-12T22:50:51.506ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64292025-08-12T22:50:51.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64302025-08-12T22:50:51.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64312025-08-12T22:50:51.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64322025-08-12T22:50:51.516ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 469.223373ms iteration = 16 status = {}
64332025-08-12T22:50:51.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8f443e02-7fda-4955-9e1b-3f1f84f317b4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64342025-08-12T22:50:51.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8f443e02-7fda-4955-9e1b-3f1f84f317b4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64352025-08-12T22:50:51.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8f443e02-7fda-4955-9e1b-3f1f84f317b4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64362025-08-12T22:50:52.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a14deeff-f248-464a-9ad8-619dc599485d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64372025-08-12T22:50:52.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a14deeff-f248-464a-9ad8-619dc599485d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64382025-08-12T22:50:52.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a14deeff-f248-464a-9ad8-619dc599485d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64392025-08-12T22:50:53.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e46fbe49-fded-4e47-aaad-b2f881f14703 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64402025-08-12T22:50:53.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e46fbe49-fded-4e47-aaad-b2f881f14703 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64412025-08-12T22:50:53.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e46fbe49-fded-4e47-aaad-b2f881f14703 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64422025-08-12T22:50:54.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3c45db17-8f26-4a40-bd40-23656de51658 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64432025-08-12T22:50:54.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3c45db17-8f26-4a40-bd40-23656de51658 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64442025-08-12T22:50:54.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3c45db17-8f26-4a40-bd40-23656de51658 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64452025-08-12T22:50:55.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 60b7720a-d6b0-4914-8bda-7036cd43518b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64462025-08-12T22:50:55.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 60b7720a-d6b0-4914-8bda-7036cd43518b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64472025-08-12T22:50:55.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 60b7720a-d6b0-4914-8bda-7036cd43518b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64482025-08-12T22:50:56.047ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 92 reason = Timeout
64492025-08-12T22:50:56.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
64502025-08-12T22:50:56.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
64512025-08-12T22:50:56.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64522025-08-12T22:50:56.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
64532025-08-12T22:50:56.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
64542025-08-12T22:50:56.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
64552025-08-12T22:50:56.053ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
64562025-08-12T22:50:56.053ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.582565ms iteration = 92 status = {"chicken_switches_updated":false}
64572025-08-12T22:50:56.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6ec6a3ca-ea87-4191-9d4d-d688aa9f248e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64582025-08-12T22:50:56.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6ec6a3ca-ea87-4191-9d4d-d688aa9f248e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64592025-08-12T22:50:56.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6ec6a3ca-ea87-4191-9d4d-d688aa9f248e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64602025-08-12T22:50:57.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6b2a1225-3004-4880-9303-9a2ad9db2d7a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64612025-08-12T22:50:57.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6b2a1225-3004-4880-9303-9a2ad9db2d7a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64622025-08-12T22:50:57.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6b2a1225-3004-4880-9303-9a2ad9db2d7a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64632025-08-12T22:50:58.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f1dbac6c-f6e2-4f02-8a0a-2f8624641ed0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64642025-08-12T22:50:58.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f1dbac6c-f6e2-4f02-8a0a-2f8624641ed0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64652025-08-12T22:50:58.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f1dbac6c-f6e2-4f02-8a0a-2f8624641ed0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64662025-08-12T22:50:58.835ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 567 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = eb50a577-c82a-44be-b9dd-ca589241589c response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
64672025-08-12T22:50:59.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = df12d86a-78bf-48ee-9de8-860c7893c9db roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64682025-08-12T22:50:59.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = df12d86a-78bf-48ee-9de8-860c7893c9db resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64692025-08-12T22:50:59.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = df12d86a-78bf-48ee-9de8-860c7893c9db response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64702025-08-12T22:51:00.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 06a5d1b4-ac49-45ad-b3d6-0f198e12bf2a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64712025-08-12T22:51:00.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 06a5d1b4-ac49-45ad-b3d6-0f198e12bf2a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64722025-08-12T22:51:00.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 06a5d1b4-ac49-45ad-b3d6-0f198e12bf2a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
64732025-08-12T22:51:01.046ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
64742025-08-12T22:51:01.046ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
64752025-08-12T22:51:01.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64762025-08-12T22:51:01.046ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64772025-08-12T22:51:01.046ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 93 reason = Timeout
64782025-08-12T22:51:01.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
64792025-08-12T22:51:01.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64802025-08-12T22:51:01.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
64812025-08-12T22:51:01.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64822025-08-12T22:51:01.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64832025-08-12T22:51:01.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64842025-08-12T22:51:01.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64852025-08-12T22:51:01.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64862025-08-12T22:51:01.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
64872025-08-12T22:51:01.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
64882025-08-12T22:51:01.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64892025-08-12T22:51:01.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
64902025-08-12T22:51:01.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
64912025-08-12T22:51:01.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.364692ms iteration = 93 status = {"chicken_switches_updated":false}
64922025-08-12T22:51:01.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64932025-08-12T22:51:01.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64942025-08-12T22:51:01.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64952025-08-12T22:51:01.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
64962025-08-12T22:51:01.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64972025-08-12T22:51:01.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64982025-08-12T22:51:01.073ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
64992025-08-12T22:51:01.073ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.711432ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
65002025-08-12T22:51:01.083ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65012025-08-12T22:51:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65022025-08-12T22:51:01.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.7382ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65032025-08-12T22:51:01.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dc82d90a-69fe-40fa-8a1c-95da0aa682ab roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65042025-08-12T22:51:01.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dc82d90a-69fe-40fa-8a1c-95da0aa682ab resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65052025-08-12T22:51:01.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dc82d90a-69fe-40fa-8a1c-95da0aa682ab response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65062025-08-12T22:51:02.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ed5cf5a9-9efd-4979-8efd-72e49f711136 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65072025-08-12T22:51:02.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ed5cf5a9-9efd-4979-8efd-72e49f711136 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65082025-08-12T22:51:02.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ed5cf5a9-9efd-4979-8efd-72e49f711136 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65092025-08-12T22:51:03.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5a64120d-8aa0-427e-b8c8-c79bf78eeaef roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65102025-08-12T22:51:03.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5a64120d-8aa0-427e-b8c8-c79bf78eeaef resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65112025-08-12T22:51:03.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5a64120d-8aa0-427e-b8c8-c79bf78eeaef response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65122025-08-12T22:51:04.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0b21f39f-286f-4f24-9857-8c86b2886476 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65132025-08-12T22:51:04.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0b21f39f-286f-4f24-9857-8c86b2886476 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65142025-08-12T22:51:04.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0b21f39f-286f-4f24-9857-8c86b2886476 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65152025-08-12T22:51:05.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5803f055-fc45-4718-89d1-246b23fb721b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65162025-08-12T22:51:05.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5803f055-fc45-4718-89d1-246b23fb721b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65172025-08-12T22:51:05.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5803f055-fc45-4718-89d1-246b23fb721b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65182025-08-12T22:51:06.047ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 94 reason = Timeout
65192025-08-12T22:51:06.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
65202025-08-12T22:51:06.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
65212025-08-12T22:51:06.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65222025-08-12T22:51:06.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
65232025-08-12T22:51:06.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
65242025-08-12T22:51:06.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
65252025-08-12T22:51:06.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
65262025-08-12T22:51:06.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.496104ms iteration = 94 status = {"chicken_switches_updated":false}
65272025-08-12T22:51:06.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9faa25d9-0224-4647-86e5-6de84e9ac83d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65282025-08-12T22:51:06.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9faa25d9-0224-4647-86e5-6de84e9ac83d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65292025-08-12T22:51:06.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9faa25d9-0224-4647-86e5-6de84e9ac83d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65302025-08-12T22:51:07.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d9f64baf-48ab-4ee3-9bb6-a9c965a0960d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65312025-08-12T22:51:07.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d9f64baf-48ab-4ee3-9bb6-a9c965a0960d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65322025-08-12T22:51:07.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d9f64baf-48ab-4ee3-9bb6-a9c965a0960d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65332025-08-12T22:51:08.834ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 489 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 5c0703a4-9439-4008-8354-539b6cf66133 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
65342025-08-12T22:51:08.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ba995865-821b-4502-8a02-6dda5a9370c0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65352025-08-12T22:51:08.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ba995865-821b-4502-8a02-6dda5a9370c0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65362025-08-12T22:51:08.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ba995865-821b-4502-8a02-6dda5a9370c0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65372025-08-12T22:51:10.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 97b58fd7-a708-401a-97b4-ff8d60dafd11 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65382025-08-12T22:51:10.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 97b58fd7-a708-401a-97b4-ff8d60dafd11 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65392025-08-12T22:51:10.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 97b58fd7-a708-401a-97b4-ff8d60dafd11 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65402025-08-12T22:51:11.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 159c6a85-c325-4d42-82f6-a9d9fcc8d3bb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65412025-08-12T22:51:11.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 159c6a85-c325-4d42-82f6-a9d9fcc8d3bb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65422025-08-12T22:51:11.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 159c6a85-c325-4d42-82f6-a9d9fcc8d3bb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65432025-08-12T22:51:11.047ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
65442025-08-12T22:51:11.047ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
65452025-08-12T22:51:11.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65462025-08-12T22:51:11.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65472025-08-12T22:51:11.047ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 95 reason = Timeout
65482025-08-12T22:51:11.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
65492025-08-12T22:51:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
65502025-08-12T22:51:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65512025-08-12T22:51:11.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65522025-08-12T22:51:11.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65532025-08-12T22:51:11.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65542025-08-12T22:51:11.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65552025-08-12T22:51:11.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65562025-08-12T22:51:11.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
65572025-08-12T22:51:11.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
65582025-08-12T22:51:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65592025-08-12T22:51:11.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65602025-08-12T22:51:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
65612025-08-12T22:51:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65622025-08-12T22:51:11.053ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
65632025-08-12T22:51:11.053ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.690835ms iteration = 95 status = {"chicken_switches_updated":false}
65642025-08-12T22:51:11.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65652025-08-12T22:51:11.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65662025-08-12T22:51:11.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65672025-08-12T22:51:11.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
65682025-08-12T22:51:11.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65692025-08-12T22:51:11.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65702025-08-12T22:51:11.071ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
65712025-08-12T22:51:11.071ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.256127ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
65722025-08-12T22:51:11.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.286084ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65732025-08-12T22:51:12.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc94f9c0-2871-4273-93d7-8acea67b61b1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65742025-08-12T22:51:12.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc94f9c0-2871-4273-93d7-8acea67b61b1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65752025-08-12T22:51:12.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc94f9c0-2871-4273-93d7-8acea67b61b1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65762025-08-12T22:51:13.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 053d214e-bd46-4526-9db9-18097563f246 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65772025-08-12T22:51:13.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 053d214e-bd46-4526-9db9-18097563f246 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65782025-08-12T22:51:13.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 053d214e-bd46-4526-9db9-18097563f246 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65792025-08-12T22:51:14.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1fab5a59-a24a-4ced-87da-6c11e7e52401 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65802025-08-12T22:51:14.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1fab5a59-a24a-4ced-87da-6c11e7e52401 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65812025-08-12T22:51:14.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1fab5a59-a24a-4ced-87da-6c11e7e52401 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65822025-08-12T22:51:15.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1c55df65-9313-414d-be45-0c83c4d5e5cf roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65832025-08-12T22:51:15.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1c55df65-9313-414d-be45-0c83c4d5e5cf resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65842025-08-12T22:51:15.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1c55df65-9313-414d-be45-0c83c4d5e5cf response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65852025-08-12T22:51:16.047ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 96 reason = Timeout
65862025-08-12T22:51:16.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
65872025-08-12T22:51:16.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
65882025-08-12T22:51:16.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65892025-08-12T22:51:16.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
65902025-08-12T22:51:16.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
65912025-08-12T22:51:16.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
65922025-08-12T22:51:16.054ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
65932025-08-12T22:51:16.054ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.834377ms iteration = 96 status = {"chicken_switches_updated":false}
65942025-08-12T22:51:16.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bb54c39a-1b69-41bd-aa42-5602cf8b55b6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65952025-08-12T22:51:16.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bb54c39a-1b69-41bd-aa42-5602cf8b55b6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65962025-08-12T22:51:16.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bb54c39a-1b69-41bd-aa42-5602cf8b55b6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65972025-08-12T22:51:17.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 67c439e6-690d-45f4-8b6d-afe883aeffbd roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65982025-08-12T22:51:17.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 67c439e6-690d-45f4-8b6d-afe883aeffbd resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
65992025-08-12T22:51:17.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 67c439e6-690d-45f4-8b6d-afe883aeffbd response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
66002025-08-12T22:51:18.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a4775ef8-488f-4745-8611-6bfa78f1a1e6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
66012025-08-12T22:51:18.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a4775ef8-488f-4745-8611-6bfa78f1a1e6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
66022025-08-12T22:51:18.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a4775ef8-488f-4745-8611-6bfa78f1a1e6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
66032025-08-12T22:51:18.834ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 666 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = b8e42b81-ad32-4783-95d6-4225b72bc867 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
66042025-08-12T22:51:19.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6cdcc568-f2d9-471e-8da0-0339498ff4eb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
66052025-08-12T22:51:19.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6cdcc568-f2d9-471e-8da0-0339498ff4eb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
66062025-08-12T22:51:19.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6cdcc568-f2d9-471e-8da0-0339498ff4eb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
66072025-08-12T22:51:20.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 616640ae-9d92-4ba6-8d9f-0abd9ecc7cf0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
66082025-08-12T22:51:20.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 616640ae-9d92-4ba6-8d9f-0abd9ecc7cf0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
66092025-08-12T22:51:20.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 616640ae-9d92-4ba6-8d9f-0abd9ecc7cf0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
66102025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
66112025-08-12T22:51:21.046ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0
66122025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0"}
66132025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
66142025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
66152025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
66162025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66172025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66182025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
66192025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66202025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
66212025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
66222025-08-12T22:51:21.046ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-12 22:41:21.046578607 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
66232025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
66242025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
66252025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66262025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
66272025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
66282025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
66292025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
66302025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
66312025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66322025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
66332025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 12 reason = Timeout
66342025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
66352025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 9.92\u{b5}s iteration = 12 status = "Disabled"
66362025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
66372025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
66382025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
66392025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
66402025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66412025-08-12T22:51:21.046ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66422025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
66432025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66442025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66452025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
66462025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66472025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 17 reason = Timeout
66482025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
66492025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66502025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 9.22\u{b5}s iteration = 17 status = {"disabled":true,"errors":[],"sps":[]}
66512025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66522025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 9 reason = Timeout
66532025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
66542025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 97 reason = Timeout
66552025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
66562025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
66572025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66582025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
66592025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66602025-08-12T22:51:21.046ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
66612025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
66622025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
66632025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66642025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
66652025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66662025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
66672025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66682025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
66692025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
66702025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66712025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66722025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
66732025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
66742025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
66752025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66762025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 9 reason = Timeout
66772025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
66782025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
66792025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66802025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
66812025-08-12T22:51:21.047ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
66822025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66832025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 17 reason = Timeout
66842025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
66852025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66862025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
66872025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66882025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
66892025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66902025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
66912025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66922025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66932025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
66942025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
66952025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66962025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66972025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66982025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66992025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67002025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
67012025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67022025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67032025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67042025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67052025-08-12T22:51:21.047ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3e3264d-303d-4ce7-a0ce-0090b10b154f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 282531006 } })
67062025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67072025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
67082025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67092025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67102025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
67112025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67122025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
67132025-08-12T22:51:21.047ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("043b8097-0e38-4228-bada-dac70e518148.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26cd5275-57f5-4466-a94f-f96956f55588.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 282617447 } })
67142025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67152025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67162025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67172025-08-12T22:51:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
67182025-08-12T22:51:21.048ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
67192025-08-12T22:51:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.558205ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
67202025-08-12T22:51:21.048ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
67212025-08-12T22:51:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.695517ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
67222025-08-12T22:51:21.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67232025-08-12T22:51:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67242025-08-12T22:51:21.049ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67252025-08-12T22:51:21.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67262025-08-12T22:51:21.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67272025-08-12T22:51:21.050ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 284931890 } })
67282025-08-12T22:51:21.050ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67292025-08-12T22:51:21.050ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-12 22:41:21.046578607 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
67302025-08-12T22:51:21.050ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.615705ms iteration = 9 status = {"expiration":"2025-08-12T22:41:21.046578607Z","pruned":[]}
67312025-08-12T22:51:21.050ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.486174ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
67322025-08-12T22:51:21.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67332025-08-12T22:51:21.050ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
67342025-08-12T22:51:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67352025-08-12T22:51:21.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67362025-08-12T22:51:21.051ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 286185512 } })
67372025-08-12T22:51:21.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67382025-08-12T22:51:21.051ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
67392025-08-12T22:51:21.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67402025-08-12T22:51:21.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67412025-08-12T22:51:21.052ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.820027ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67422025-08-12T22:51:21.052ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
67432025-08-12T22:51:21.052ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 5.722526ms iteration = 9 status = {"by_rx":{},"error":null}
67442025-08-12T22:51:21.053ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67452025-08-12T22:51:21.053ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67462025-08-12T22:51:21.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67472025-08-12T22:51:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67482025-08-12T22:51:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67492025-08-12T22:51:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67502025-08-12T22:51:21.054ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67512025-08-12T22:51:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67522025-08-12T22:51:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67532025-08-12T22:51:21.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67542025-08-12T22:51:21.055ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 8.880447ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67552025-08-12T22:51:21.056ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67562025-08-12T22:51:21.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67572025-08-12T22:51:21.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67582025-08-12T22:51:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67592025-08-12T22:51:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67602025-08-12T22:51:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67612025-08-12T22:51:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67622025-08-12T22:51:21.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67632025-08-12T22:51:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67642025-08-12T22:51:21.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67652025-08-12T22:51:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67662025-08-12T22:51:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67672025-08-12T22:51:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67682025-08-12T22:51:21.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67692025-08-12T22:51:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67702025-08-12T22:51:21.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67712025-08-12T22:51:21.059ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
67722025-08-12T22:51:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
67732025-08-12T22:51:21.059ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
67742025-08-12T22:51:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
67752025-08-12T22:51:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
67762025-08-12T22:51:21.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67772025-08-12T22:51:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67782025-08-12T22:51:21.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67792025-08-12T22:51:21.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67802025-08-12T22:51:21.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67812025-08-12T22:51:21.062ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
67822025-08-12T22:51:21.062ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 15.723284ms iteration = 97 status = {"chicken_switches_updated":false}
67832025-08-12T22:51:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67842025-08-12T22:51:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67852025-08-12T22:51:21.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67862025-08-12T22:51:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67872025-08-12T22:51:21.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67882025-08-12T22:51:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67892025-08-12T22:51:21.065ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 18.811594ms iteration = 9 status = {"dispatched":[],"errors":[],"glob_version":"180.0.0","globs_reprocessed":{},"no_receivers":[]}
67902025-08-12T22:51:21.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67912025-08-12T22:51:21.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67922025-08-12T22:51:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67932025-08-12T22:51:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67942025-08-12T22:51:21.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67952025-08-12T22:51:21.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67962025-08-12T22:51:21.069ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67972025-08-12T22:51:21.069ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 23.067857ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67982025-08-12T22:51:21.070ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1483, tv_nsec: 305521062 } })
67992025-08-12T22:51:21.070ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
68002025-08-12T22:51:21.071ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68012025-08-12T22:51:21.071ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.302398ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68022025-08-12T22:51:21.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68032025-08-12T22:51:21.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68042025-08-12T22:51:21.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68052025-08-12T22:51:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
68062025-08-12T22:51:21.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68072025-08-12T22:51:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68082025-08-12T22:51:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
68092025-08-12T22:51:21.073ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68102025-08-12T22:51:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68112025-08-12T22:51:21.077ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68122025-08-12T22:51:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68132025-08-12T22:51:21.079ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68142025-08-12T22:51:21.081ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68152025-08-12T22:51:21.081ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68162025-08-12T22:51:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68172025-08-12T22:51:21.100ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
68182025-08-12T22:51:21.100ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.482165ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
68192025-08-12T22:51:21.106ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
68202025-08-12T22:51:21.106ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
68212025-08-12T22:51:21.106ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 60.006739ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
68222025-08-12T22:51:21.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.1354ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
68232025-08-12T22:51:21.108ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68242025-08-12T22:51:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68252025-08-12T22:51:21.110ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68262025-08-12T22:51:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68272025-08-12T22:51:21.111ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68282025-08-12T22:51:21.111ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68292025-08-12T22:51:21.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68302025-08-12T22:51:21.111ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68312025-08-12T22:51:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68322025-08-12T22:51:21.112ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 65.153289ms iteration = 17 status = {"errors":[],"requests_created_ok":[]}
68332025-08-12T22:51:21.113ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 66.257459ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
68342025-08-12T22:51:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
68352025-08-12T22:51:21.113ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68362025-08-12T22:51:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68372025-08-12T22:51:21.114ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68382025-08-12T22:51:21.114ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68392025-08-12T22:51:21.114ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68402025-08-12T22:51:21.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68412025-08-12T22:51:21.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68422025-08-12T22:51:21.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
68432025-08-12T22:51:21.116ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68442025-08-12T22:51:21.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
68452025-08-12T22:51:21.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.858855ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
68462025-08-12T22:51:21.118ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68472025-08-12T22:51:21.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68482025-08-12T22:51:21.121ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
68492025-08-12T22:51:21.121ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
68502025-08-12T22:51:21.121ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
68512025-08-12T22:51:21.121ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68522025-08-12T22:51:21.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68532025-08-12T22:51:21.122ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68542025-08-12T22:51:21.125ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68552025-08-12T22:51:21.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68562025-08-12T22:51:21.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68572025-08-12T22:51:21.126ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
68582025-08-12T22:51:21.126ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
68592025-08-12T22:51:21.126ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
68602025-08-12T22:51:21.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68612025-08-12T22:51:21.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68622025-08-12T22:51:21.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68632025-08-12T22:51:21.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68642025-08-12T22:51:21.127ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.222527ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68652025-08-12T22:51:21.131ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68662025-08-12T22:51:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68672025-08-12T22:51:21.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68682025-08-12T22:51:21.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68692025-08-12T22:51:21.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68702025-08-12T22:51:21.135ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-12T22:43:09.981233Z, time_modified: 2025-08-12T22:43:09.981233Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }) }
68712025-08-12T22:51:21.135ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 89.421807ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]}},"default_endpoint":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
68722025-08-12T22:51:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
68732025-08-12T22:51:21.138ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68742025-08-12T22:51:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68752025-08-12T22:51:21.140ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.985801ms iteration = 17 status = 0
68762025-08-12T22:51:21.163ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68772025-08-12T22:51:21.163ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68782025-08-12T22:51:21.163ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 116.616214ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68792025-08-12T22:51:21.166ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68802025-08-12T22:51:21.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
68812025-08-12T22:51:21.169ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68822025-08-12T22:51:21.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68832025-08-12T22:51:21.171ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
68842025-08-12T22:51:21.171ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
68852025-08-12T22:51:21.171ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 124.886385ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
68862025-08-12T22:51:21.185ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68872025-08-12T22:51:21.185ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
68882025-08-12T22:51:21.185ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
68892025-08-12T22:51:21.185ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68902025-08-12T22:51:21.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68912025-08-12T22:51:21.187ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68922025-08-12T22:51:21.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68932025-08-12T22:51:21.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68942025-08-12T22:51:21.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68952025-08-12T22:51:21.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69ab4b51-3378-4ed6-95a1-074d4ab714a9 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
68962025-08-12T22:51:21.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69ab4b51-3378-4ed6-95a1-074d4ab714a9 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
68972025-08-12T22:51:21.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68982025-08-12T22:51:21.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68992025-08-12T22:51:21.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69002025-08-12T22:51:21.191ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
69012025-08-12T22:51:21.191ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 0 version = 2
69022025-08-12T22:51:21.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69032025-08-12T22:51:21.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69042025-08-12T22:51:21.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69ab4b51-3378-4ed6-95a1-074d4ab714a9 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
69052025-08-12T22:51:21.193ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
69062025-08-12T22:51:21.193ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
69072025-08-12T22:51:21.193ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-12 22:43:49.909589 UTC dns_group = internal generation = 1
69082025-08-12T22:51:21.194ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 147.363565ms iteration = 9 status = {"generation":1}
69092025-08-12T22:51:21.194ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69102025-08-12T22:51:21.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69112025-08-12T22:51:21.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69122025-08-12T22:51:21.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69132025-08-12T22:51:21.200ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 4 version = 2
69142025-08-12T22:51:21.200ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
69152025-08-12T22:51:21.200ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-12 22:43:50.527483 UTC dns_group = external generation = 2
69162025-08-12T22:51:21.200ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 153.97662ms iteration = 9 status = {"generation":2}
69172025-08-12T22:51:21.211ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
69182025-08-12T22:51:21.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69192025-08-12T22:51:21.216ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69202025-08-12T22:51:21.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69212025-08-12T22:51:21.218ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
69222025-08-12T22:51:21.218ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 171.963617ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
69232025-08-12T22:51:21.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69242025-08-12T22:51:21.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69252025-08-12T22:51:21.227ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69262025-08-12T22:51:21.228ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69272025-08-12T22:51:21.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69282025-08-12T22:51:21.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69292025-08-12T22:51:21.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69302025-08-12T22:51:21.232ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69312025-08-12T22:51:21.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69322025-08-12T22:51:21.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69332025-08-12T22:51:21.234ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 187.63206ms iteration = 19 status = {"physical_disks_added":0}
69342025-08-12T22:51:21.235ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
69352025-08-12T22:51:21.334ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
69362025-08-12T22:51:21.334ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 287.869504ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
69372025-08-12T22:51:21.346ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
69382025-08-12T22:51:21.346ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69392025-08-12T22:51:21.347ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9f9bb53-699c-42d8-82dd-cfd70cdf30b1", "content-length": "26", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} })
69402025-08-12T22:51:21.347ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69412025-08-12T22:51:21.350ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69422025-08-12T22:51:21.350ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
69432025-08-12T22:51:21.350ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69442025-08-12T22:51:21.351ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "06b92398-9094-4f89-9263-c60223a82982", "content-length": "26", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} })
69452025-08-12T22:51:21.351ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69462025-08-12T22:51:21.352ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69472025-08-12T22:51:21.363ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
69482025-08-12T22:51:21.389ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
69492025-08-12T22:51:21.389ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69502025-08-12T22:51:21.390ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c28e6791-a529-4261-a823-a97f76a3bd24", "content-length": "26", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} })
69512025-08-12T22:51:21.390ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69522025-08-12T22:51:21.392ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
69532025-08-12T22:51:21.392ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69542025-08-12T22:51:21.392ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c61a4b9-0f93-43a2-9535-100179dde607", "content-length": "372", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} })
69552025-08-12T22:51:21.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69562025-08-12T22:51:21.392ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
69572025-08-12T22:51:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69582025-08-12T22:51:21.433ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
69592025-08-12T22:51:21.433ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ca9200c2-9398-447a-ab63-be36704f4c82", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69602025-08-12T22:51:21.433ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69612025-08-12T22:51:21.435ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "133f88a8-851d-4e20-8578-1ffbbe90ceb3", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69622025-08-12T22:51:21.435ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69632025-08-12T22:51:21.438ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69642025-08-12T22:51:21.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 391.901284ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
69652025-08-12T22:51:21.487ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
69662025-08-12T22:51:21.487ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69672025-08-12T22:51:21.487ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "42be4941-c722-49ad-8c53-c45407e775ca", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} })
69682025-08-12T22:51:21.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69692025-08-12T22:51:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69702025-08-12T22:51:21.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69712025-08-12T22:51:21.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69722025-08-12T22:51:21.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69732025-08-12T22:51:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69742025-08-12T22:51:21.497ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69752025-08-12T22:51:21.497ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69762025-08-12T22:51:21.498ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "985330e0-f69e-477e-8867-efc5cdd92558", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} })
69772025-08-12T22:51:21.500ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 454.174714ms iteration = 17 status = {}
69782025-08-12T22:51:21.538ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69792025-08-12T22:51:21.539ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0eafb0f-c1dc-4ea5-8157-2b906d344b4a", "content-length": "691", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} })
69802025-08-12T22:51:21.539ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69812025-08-12T22:51:21.539ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69822025-08-12T22:51:21.539ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69832025-08-12T22:51:21.541ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 494.366969ms iteration = 17 status = {}
69842025-08-12T22:51:21.543ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 497.193957ms iteration = 17 status = {}
69852025-08-12T22:51:21.635ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69862025-08-12T22:51:21.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69872025-08-12T22:51:21.636ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
69882025-08-12T22:51:21.637ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 591.416621ms iteration = 17 status = null
69892025-08-12T22:51:21.695ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
69902025-08-12T22:51:21.696ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ef23aec5-99c9-4824-bfcd-222b81a0ae38", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69912025-08-12T22:51:21.696ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69922025-08-12T22:51:21.698ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "94999893-3c64-4306-a338-9e8eb0ce681c", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69932025-08-12T22:51:21.698ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69942025-08-12T22:51:21.700ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c53ef2e5-ec04-4a43-8c27-e31941bd6277", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69952025-08-12T22:51:21.700ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69962025-08-12T22:51:21.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69972025-08-12T22:51:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69982025-08-12T22:51:21.702ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69992025-08-12T22:51:21.702ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 655.893102ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
70002025-08-12T22:51:21.704ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
70012025-08-12T22:51:21.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70022025-08-12T22:51:21.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70032025-08-12T22:51:21.718ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
70042025-08-12T22:51:21.718ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
70052025-08-12T22:51:21.718ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
70062025-08-12T22:51:21.718ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70072025-08-12T22:51:21.718ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70082025-08-12T22:51:21.718ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70092025-08-12T22:51:21.718ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70102025-08-12T22:51:21.718ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70112025-08-12T22:51:21.718ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70122025-08-12T22:51:21.718ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70132025-08-12T22:51:21.718ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
70142025-08-12T22:51:21.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70152025-08-12T22:51:21.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70162025-08-12T22:51:21.722ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
70172025-08-12T22:51:21.722ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
70182025-08-12T22:51:21.833ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6f546724-39bf-4cbb-ba7f-4f68eb847df6", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} })
70192025-08-12T22:51:21.833ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
70202025-08-12T22:51:21.833ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
70212025-08-12T22:51:21.833ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ca31a76-57dd-49d4-931c-29ca610a828a", "content-length": "682", "date": "Tue, 12 Aug 2025 22:51:21 GMT"} })
70222025-08-12T22:51:21.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70232025-08-12T22:51:21.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70242025-08-12T22:51:21.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70252025-08-12T22:51:21.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70262025-08-12T22:51:21.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70272025-08-12T22:51:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70282025-08-12T22:51:21.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70292025-08-12T22:51:21.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70302025-08-12T22:51:21.850ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 803.454109ms iteration = 17 status = {}
70312025-08-12T22:51:22.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6da8ba3b-c085-48d7-be64-a4751206dec8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70322025-08-12T22:51:22.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6da8ba3b-c085-48d7-be64-a4751206dec8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70332025-08-12T22:51:22.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6da8ba3b-c085-48d7-be64-a4751206dec8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70342025-08-12T22:51:23.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 214ae403-10e7-467e-81a1-0e349cbc2ec7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70352025-08-12T22:51:23.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 214ae403-10e7-467e-81a1-0e349cbc2ec7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70362025-08-12T22:51:23.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 214ae403-10e7-467e-81a1-0e349cbc2ec7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70372025-08-12T22:51:24.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4157ca86-48a0-4ddf-9094-a61540691b71 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70382025-08-12T22:51:24.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4157ca86-48a0-4ddf-9094-a61540691b71 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70392025-08-12T22:51:24.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4157ca86-48a0-4ddf-9094-a61540691b71 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70402025-08-12T22:51:25.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be77502f-3bdc-4c97-83d3-531f2b3080f8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70412025-08-12T22:51:25.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be77502f-3bdc-4c97-83d3-531f2b3080f8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70422025-08-12T22:51:25.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be77502f-3bdc-4c97-83d3-531f2b3080f8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70432025-08-12T22:51:26.047ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 98 reason = Timeout
70442025-08-12T22:51:26.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
70452025-08-12T22:51:26.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
70462025-08-12T22:51:26.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70472025-08-12T22:51:26.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
70482025-08-12T22:51:26.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
70492025-08-12T22:51:26.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
70502025-08-12T22:51:26.054ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
70512025-08-12T22:51:26.054ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.13194ms iteration = 98 status = {"chicken_switches_updated":false}
70522025-08-12T22:51:26.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c6846669-56e3-4bd9-800b-b00e9091c2de roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70532025-08-12T22:51:26.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c6846669-56e3-4bd9-800b-b00e9091c2de resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70542025-08-12T22:51:26.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1760 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c6846669-56e3-4bd9-800b-b00e9091c2de response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70552025-08-12T22:51:27.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7f0e0dae-5c37-4f5b-8efe-df31549c33ed roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70562025-08-12T22:51:27.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7f0e0dae-5c37-4f5b-8efe-df31549c33ed resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70572025-08-12T22:51:27.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7f0e0dae-5c37-4f5b-8efe-df31549c33ed response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70582025-08-12T22:51:28.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 01e1184e-566e-4010-9b84-5f58a8fa11b1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70592025-08-12T22:51:28.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 01e1184e-566e-4010-9b84-5f58a8fa11b1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70602025-08-12T22:51:28.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 01e1184e-566e-4010-9b84-5f58a8fa11b1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70612025-08-12T22:51:28.835ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 545 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 1bdc6db5-475f-43b9-9d61-ad423ad26590 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
70622025-08-12T22:51:29.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b0aabd2-16a6-480f-827c-02c0625df4ea roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70632025-08-12T22:51:29.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b0aabd2-16a6-480f-827c-02c0625df4ea resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70642025-08-12T22:51:29.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b0aabd2-16a6-480f-827c-02c0625df4ea response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70652025-08-12T22:51:30.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bb19bd90-34e2-42eb-b7c1-86b9489c8b36 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70662025-08-12T22:51:30.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bb19bd90-34e2-42eb-b7c1-86b9489c8b36 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70672025-08-12T22:51:30.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bb19bd90-34e2-42eb-b7c1-86b9489c8b36 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70682025-08-12T22:51:31.047ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
70692025-08-12T22:51:31.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70702025-08-12T22:51:31.047ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
70712025-08-12T22:51:31.047ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 99 reason = Timeout
70722025-08-12T22:51:31.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
70732025-08-12T22:51:31.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70742025-08-12T22:51:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70752025-08-12T22:51:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
70762025-08-12T22:51:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70772025-08-12T22:51:31.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70782025-08-12T22:51:31.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70792025-08-12T22:51:31.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70802025-08-12T22:51:31.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70812025-08-12T22:51:31.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70822025-08-12T22:51:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
70832025-08-12T22:51:31.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
70842025-08-12T22:51:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
70852025-08-12T22:51:31.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70862025-08-12T22:51:31.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70872025-08-12T22:51:31.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
70882025-08-12T22:51:31.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.869617ms iteration = 99 status = {"chicken_switches_updated":false}
70892025-08-12T22:51:31.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70902025-08-12T22:51:31.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
70912025-08-12T22:51:31.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70922025-08-12T22:51:31.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70932025-08-12T22:51:31.076ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
70942025-08-12T22:51:31.076ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.169546ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
70952025-08-12T22:51:31.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70962025-08-12T22:51:31.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70972025-08-12T22:51:31.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.136388ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70982025-08-12T22:51:31.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4dd264ae-98e1-46f9-ac4b-9bf85f5c89f5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
70992025-08-12T22:51:31.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4dd264ae-98e1-46f9-ac4b-9bf85f5c89f5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71002025-08-12T22:51:31.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4dd264ae-98e1-46f9-ac4b-9bf85f5c89f5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71012025-08-12T22:51:32.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f98bab88-3fe0-43bf-92ff-33cb4fda150d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71022025-08-12T22:51:32.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f98bab88-3fe0-43bf-92ff-33cb4fda150d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71032025-08-12T22:51:32.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f98bab88-3fe0-43bf-92ff-33cb4fda150d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71042025-08-12T22:51:33.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc6c3a22-b329-4d84-abcb-e34416bb9759 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71052025-08-12T22:51:33.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc6c3a22-b329-4d84-abcb-e34416bb9759 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71062025-08-12T22:51:33.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc6c3a22-b329-4d84-abcb-e34416bb9759 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71072025-08-12T22:51:34.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 292f1129-985f-42ad-9213-80d16e5779bd roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71082025-08-12T22:51:34.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 292f1129-985f-42ad-9213-80d16e5779bd resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71092025-08-12T22:51:34.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 292f1129-985f-42ad-9213-80d16e5779bd response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71102025-08-12T22:51:35.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7aa061a4-b85e-4be5-9f8e-c6572bb106c2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71112025-08-12T22:51:35.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7aa061a4-b85e-4be5-9f8e-c6572bb106c2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71122025-08-12T22:51:35.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7aa061a4-b85e-4be5-9f8e-c6572bb106c2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71132025-08-12T22:51:36.047ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 100 reason = Timeout
71142025-08-12T22:51:36.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
71152025-08-12T22:51:36.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
71162025-08-12T22:51:36.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71172025-08-12T22:51:36.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
71182025-08-12T22:51:36.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
71192025-08-12T22:51:36.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
71202025-08-12T22:51:36.054ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
71212025-08-12T22:51:36.054ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.068239ms iteration = 100 status = {"chicken_switches_updated":false}
71222025-08-12T22:51:36.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e03a4d5f-f7b6-44b5-80d3-13d90d0a789e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71232025-08-12T22:51:36.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e03a4d5f-f7b6-44b5-80d3-13d90d0a789e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71242025-08-12T22:51:36.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e03a4d5f-f7b6-44b5-80d3-13d90d0a789e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71252025-08-12T22:51:37.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ce69e5c6-0fb7-4297-af26-fc40aab08ed0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71262025-08-12T22:51:37.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ce69e5c6-0fb7-4297-af26-fc40aab08ed0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71272025-08-12T22:51:37.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ce69e5c6-0fb7-4297-af26-fc40aab08ed0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71282025-08-12T22:51:38.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f1d37bbe-034f-4d83-9cdb-e8e2d63e4c8e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71292025-08-12T22:51:38.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f1d37bbe-034f-4d83-9cdb-e8e2d63e4c8e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71302025-08-12T22:51:38.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f1d37bbe-034f-4d83-9cdb-e8e2d63e4c8e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71312025-08-12T22:51:38.835ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 490 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 26c7de56-df95-4de3-97d6-ea67a1d96935 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
71322025-08-12T22:51:39.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7a0654d8-c273-4632-8600-31c8da143bf4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71332025-08-12T22:51:39.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7a0654d8-c273-4632-8600-31c8da143bf4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71342025-08-12T22:51:39.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7a0654d8-c273-4632-8600-31c8da143bf4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71352025-08-12T22:51:40.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2ecc642d-48e3-4273-9981-a5389cefd4ca roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71362025-08-12T22:51:40.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2ecc642d-48e3-4273-9981-a5389cefd4ca resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71372025-08-12T22:51:40.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2ecc642d-48e3-4273-9981-a5389cefd4ca response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71382025-08-12T22:51:41.047ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
71392025-08-12T22:51:41.047ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
71402025-08-12T22:51:41.047ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 101 reason = Timeout
71412025-08-12T22:51:41.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71422025-08-12T22:51:41.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71432025-08-12T22:51:41.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
71442025-08-12T22:51:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71452025-08-12T22:51:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
71462025-08-12T22:51:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71472025-08-12T22:51:41.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71482025-08-12T22:51:41.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71492025-08-12T22:51:41.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71502025-08-12T22:51:41.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71512025-08-12T22:51:41.052ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.570925ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71522025-08-12T22:51:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71532025-08-12T22:51:41.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71542025-08-12T22:51:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71552025-08-12T22:51:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
71562025-08-12T22:51:41.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
71572025-08-12T22:51:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
71582025-08-12T22:51:41.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71592025-08-12T22:51:41.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71602025-08-12T22:51:41.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
71612025-08-12T22:51:41.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.643435ms iteration = 101 status = {"chicken_switches_updated":false}
71622025-08-12T22:51:41.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71632025-08-12T22:51:41.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
71642025-08-12T22:51:41.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71652025-08-12T22:51:41.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71662025-08-12T22:51:41.072ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
71672025-08-12T22:51:41.072ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.378219ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
71682025-08-12T22:51:41.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 72da97bb-192c-430c-8153-8459897cd5b6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71692025-08-12T22:51:41.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 72da97bb-192c-430c-8153-8459897cd5b6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71702025-08-12T22:51:41.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 72da97bb-192c-430c-8153-8459897cd5b6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71712025-08-12T22:51:42.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b478e064-928b-43f1-aad4-3bcfa36029d2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71722025-08-12T22:51:42.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b478e064-928b-43f1-aad4-3bcfa36029d2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71732025-08-12T22:51:42.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b478e064-928b-43f1-aad4-3bcfa36029d2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71742025-08-12T22:51:43.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c444aa08-6bb5-43f7-94c8-67cb52b5f9ec roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71752025-08-12T22:51:43.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c444aa08-6bb5-43f7-94c8-67cb52b5f9ec resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71762025-08-12T22:51:43.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c444aa08-6bb5-43f7-94c8-67cb52b5f9ec response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71772025-08-12T22:51:44.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1961ddc2-165b-4781-8660-6bfd15b69585 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71782025-08-12T22:51:44.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1961ddc2-165b-4781-8660-6bfd15b69585 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71792025-08-12T22:51:44.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1961ddc2-165b-4781-8660-6bfd15b69585 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71802025-08-12T22:51:45.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6a2bfb4d-9330-4eea-824c-cb13079d2eb7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71812025-08-12T22:51:45.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6a2bfb4d-9330-4eea-824c-cb13079d2eb7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71822025-08-12T22:51:45.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6a2bfb4d-9330-4eea-824c-cb13079d2eb7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71832025-08-12T22:51:46.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 102 reason = Timeout
71842025-08-12T22:51:46.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
71852025-08-12T22:51:46.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
71862025-08-12T22:51:46.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71872025-08-12T22:51:46.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
71882025-08-12T22:51:46.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
71892025-08-12T22:51:46.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
71902025-08-12T22:51:46.054ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
71912025-08-12T22:51:46.054ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.928388ms iteration = 102 status = {"chicken_switches_updated":false}
71922025-08-12T22:51:46.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 20ed69cc-5258-451d-9bd2-3ee619737b6e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71932025-08-12T22:51:46.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 20ed69cc-5258-451d-9bd2-3ee619737b6e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71942025-08-12T22:51:46.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 20ed69cc-5258-451d-9bd2-3ee619737b6e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71952025-08-12T22:51:47.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7158729a-e26a-4bfe-9eaa-83518ab09f5a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71962025-08-12T22:51:47.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7158729a-e26a-4bfe-9eaa-83518ab09f5a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71972025-08-12T22:51:47.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7158729a-e26a-4bfe-9eaa-83518ab09f5a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71982025-08-12T22:51:48.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1c9b2d77-b515-4830-a482-15608cba4344 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
71992025-08-12T22:51:48.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1c9b2d77-b515-4830-a482-15608cba4344 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
72002025-08-12T22:51:48.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1c9b2d77-b515-4830-a482-15608cba4344 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
72012025-08-12T22:51:48.835ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 505 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 8301736e-9c7a-448f-9d8b-0e82b6ed346a response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
72022025-08-12T22:51:49.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3c5a588b-700a-426c-b3b1-6d67e66333c5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
72032025-08-12T22:51:49.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3c5a588b-700a-426c-b3b1-6d67e66333c5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
72042025-08-12T22:51:49.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3c5a588b-700a-426c-b3b1-6d67e66333c5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
72052025-08-12T22:51:50.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8a560b47-b864-4d8a-aa4a-190fb5550681 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
72062025-08-12T22:51:50.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8a560b47-b864-4d8a-aa4a-190fb5550681 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
72072025-08-12T22:51:50.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8a560b47-b864-4d8a-aa4a-190fb5550681 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
72082025-08-12T22:51:51.046ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
72092025-08-12T22:51:51.046ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
72102025-08-12T22:51:51.046ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
72112025-08-12T22:51:51.046ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72122025-08-12T22:51:51.046ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72132025-08-12T22:51:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
72142025-08-12T22:51:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72152025-08-12T22:51:51.047ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 18 reason = Timeout
72162025-08-12T22:51:51.047ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 12.14\u{b5}s iteration = 18 status = {"disabled":true,"errors":[],"sps":[]}
72172025-08-12T22:51:51.047ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
72182025-08-12T22:51:51.047ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
72192025-08-12T22:51:51.047ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
72202025-08-12T22:51:51.047ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 18 reason = Timeout
72212025-08-12T22:51:51.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72222025-08-12T22:51:51.047ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
72232025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
72242025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
72252025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72262025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
72272025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
72282025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72292025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
72302025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
72312025-08-12T22:51:51.048ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
72322025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72332025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
72342025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72352025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
72362025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
72372025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72382025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
72392025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
72402025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72412025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
72422025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72432025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
72442025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72452025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
72462025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72472025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
72482025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72492025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 103 reason = Timeout
72502025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
72512025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
72522025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72532025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
72542025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
72552025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72562025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72572025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72582025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72592025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
72602025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72612025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72622025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72632025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72642025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72652025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72662025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72672025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
72682025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72692025-08-12T22:51:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
72702025-08-12T22:51:51.050ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1513, tv_nsec: 284400603 } })
72712025-08-12T22:51:51.050ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72722025-08-12T22:51:51.050ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
72732025-08-12T22:51:51.050ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72742025-08-12T22:51:51.050ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1513, tv_nsec: 285025239 } })
72752025-08-12T22:51:51.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72762025-08-12T22:51:51.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72772025-08-12T22:51:51.050ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72782025-08-12T22:51:51.051ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
72792025-08-12T22:51:51.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72802025-08-12T22:51:51.051ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.883598ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72812025-08-12T22:51:51.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72822025-08-12T22:51:51.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72832025-08-12T22:51:51.054ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72842025-08-12T22:51:51.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72852025-08-12T22:51:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72862025-08-12T22:51:51.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72872025-08-12T22:51:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
72882025-08-12T22:51:51.055ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
72892025-08-12T22:51:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72902025-08-12T22:51:51.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72912025-08-12T22:51:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72922025-08-12T22:51:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
72932025-08-12T22:51:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72942025-08-12T22:51:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72952025-08-12T22:51:51.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72962025-08-12T22:51:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72972025-08-12T22:51:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
72982025-08-12T22:51:51.056ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
72992025-08-12T22:51:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73002025-08-12T22:51:51.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73012025-08-12T22:51:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
73022025-08-12T22:51:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73032025-08-12T22:51:51.057ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73042025-08-12T22:51:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73052025-08-12T22:51:51.057ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73062025-08-12T22:51:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73072025-08-12T22:51:51.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73082025-08-12T22:51:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73092025-08-12T22:51:51.058ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1513, tv_nsec: 292909686 } })
73102025-08-12T22:51:51.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73112025-08-12T22:51:51.058ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
73122025-08-12T22:51:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73132025-08-12T22:51:51.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73142025-08-12T22:51:51.059ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
73152025-08-12T22:51:51.059ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 10.931437ms iteration = 103 status = {"chicken_switches_updated":false}
73162025-08-12T22:51:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73172025-08-12T22:51:51.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73182025-08-12T22:51:51.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73192025-08-12T22:51:51.061ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73202025-08-12T22:51:51.061ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 13.433772ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73212025-08-12T22:51:51.061ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 13.702584ms iteration = 18 status = {"errors":[],"requests_created_ok":[]}
73222025-08-12T22:51:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73232025-08-12T22:51:51.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73242025-08-12T22:51:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73252025-08-12T22:51:51.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
73262025-08-12T22:51:51.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73272025-08-12T22:51:51.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73282025-08-12T22:51:51.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73292025-08-12T22:51:51.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73302025-08-12T22:51:51.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73312025-08-12T22:51:51.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73322025-08-12T22:51:51.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73332025-08-12T22:51:51.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73342025-08-12T22:51:51.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73352025-08-12T22:51:51.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73362025-08-12T22:51:51.078ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73372025-08-12T22:51:51.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73382025-08-12T22:51:51.084ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
73392025-08-12T22:51:51.084ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.085874ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
73402025-08-12T22:51:51.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.652206ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
73412025-08-12T22:51:51.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.750577ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
73422025-08-12T22:51:51.106ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
73432025-08-12T22:51:51.106ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73442025-08-12T22:51:51.106ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "18f059e9-4572-4fc9-97cc-7ebf603500b7", "content-length": "26", "date": "Tue, 12 Aug 2025 22:51:51 GMT"} })
73452025-08-12T22:51:51.106ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73462025-08-12T22:51:51.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73472025-08-12T22:51:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73482025-08-12T22:51:51.107ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73492025-08-12T22:51:51.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73502025-08-12T22:51:51.108ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73512025-08-12T22:51:51.111ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73522025-08-12T22:51:51.111ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
73532025-08-12T22:51:51.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73542025-08-12T22:51:51.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73552025-08-12T22:51:51.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73562025-08-12T22:51:51.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73572025-08-12T22:51:51.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73582025-08-12T22:51:51.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73592025-08-12T22:51:51.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73602025-08-12T22:51:51.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73612025-08-12T22:51:51.116ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73622025-08-12T22:51:51.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73632025-08-12T22:51:51.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73642025-08-12T22:51:51.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73652025-08-12T22:51:51.117ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73662025-08-12T22:51:51.118ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73672025-08-12T22:51:51.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
73682025-08-12T22:51:51.120ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73692025-08-12T22:51:51.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73702025-08-12T22:51:51.121ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
73712025-08-12T22:51:51.121ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73722025-08-12T22:51:51.121ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73732025-08-12T22:51:51.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73742025-08-12T22:51:51.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73752025-08-12T22:51:51.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
73762025-08-12T22:51:51.123ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "34b8438d-28bc-47c9-8374-e5b1e514179a", "content-length": "26", "date": "Tue, 12 Aug 2025 22:51:51 GMT"} })
73772025-08-12T22:51:51.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73782025-08-12T22:51:51.123ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73792025-08-12T22:51:51.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73802025-08-12T22:51:51.124ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73812025-08-12T22:51:51.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73822025-08-12T22:51:51.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73832025-08-12T22:51:51.125ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 77.091806ms iteration = 18 status = 0
73842025-08-12T22:51:51.125ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73852025-08-12T22:51:51.137ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
73862025-08-12T22:51:51.138ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73872025-08-12T22:51:51.138ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b06cbde9-f3ef-4e7e-ae68-2da568e16ec7", "content-length": "26", "date": "Tue, 12 Aug 2025 22:51:51 GMT"} })
73882025-08-12T22:51:51.138ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73892025-08-12T22:51:51.140ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
73902025-08-12T22:51:51.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.705007ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73912025-08-12T22:51:51.162ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73922025-08-12T22:51:51.162ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73932025-08-12T22:51:51.162ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73942025-08-12T22:51:51.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73952025-08-12T22:51:51.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 114.625644ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73962025-08-12T22:51:51.166ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73972025-08-12T22:51:51.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73982025-08-12T22:51:51.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.017207ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73992025-08-12T22:51:51.173ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
74002025-08-12T22:51:51.173ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 125.514051ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
74012025-08-12T22:51:51.205ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74022025-08-12T22:51:51.205ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74032025-08-12T22:51:51.205ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 157.518095ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74042025-08-12T22:51:51.205ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 157.354644ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
74052025-08-12T22:51:51.207ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.268742ms iteration = 20 status = {"physical_disks_added":0}
74062025-08-12T22:51:51.239ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74072025-08-12T22:51:51.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74082025-08-12T22:51:51.242ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 195.75459ms iteration = 18 status = null
74092025-08-12T22:51:51.254ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 207.364804ms iteration = 18 status = {}
74102025-08-12T22:51:51.291ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74112025-08-12T22:51:51.292ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "01a50f10-fbb3-4cf3-9360-b078b5ff7743", "content-length": "691", "date": "Tue, 12 Aug 2025 22:51:51 GMT"} })
74122025-08-12T22:51:51.292ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
74132025-08-12T22:51:51.292ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
74142025-08-12T22:51:51.292ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
74152025-08-12T22:51:51.293ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 245.494568ms iteration = 18 status = {}
74162025-08-12T22:51:51.310ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
74172025-08-12T22:51:51.310ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74182025-08-12T22:51:51.310ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3a06642-1163-4e7b-b6b9-f7238d5c111c", "content-length": "372", "date": "Tue, 12 Aug 2025 22:51:51 GMT"} })
74192025-08-12T22:51:51.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74202025-08-12T22:51:51.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74212025-08-12T22:51:51.324ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
74222025-08-12T22:51:51.324ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
74232025-08-12T22:51:51.324ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e2189148-0cff-4cdc-9675-2e2b529a3292", "date": "Tue, 12 Aug 2025 22:51:51 GMT"} })
74242025-08-12T22:51:51.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74252025-08-12T22:51:51.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74262025-08-12T22:51:51.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74272025-08-12T22:51:51.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74282025-08-12T22:51:51.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74292025-08-12T22:51:51.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74302025-08-12T22:51:51.332ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74312025-08-12T22:51:51.332ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74322025-08-12T22:51:51.332ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "81c02e01-d6dc-4622-b4b6-248e067e0ff6", "date": "Tue, 12 Aug 2025 22:51:51 GMT"} })
74332025-08-12T22:51:51.333ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 285.727533ms iteration = 18 status = {}
74342025-08-12T22:51:51.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74352025-08-12T22:51:51.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74362025-08-12T22:51:51.393ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
74372025-08-12T22:51:51.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74382025-08-12T22:51:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74392025-08-12T22:51:51.411ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
74402025-08-12T22:51:51.411ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
74412025-08-12T22:51:51.411ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
74422025-08-12T22:51:51.411ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74432025-08-12T22:51:51.411ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74442025-08-12T22:51:51.411ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74452025-08-12T22:51:51.411ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74462025-08-12T22:51:51.411ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74472025-08-12T22:51:51.412ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74482025-08-12T22:51:51.412ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74492025-08-12T22:51:51.412ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
74502025-08-12T22:51:51.412ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74512025-08-12T22:51:51.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74522025-08-12T22:51:51.414ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
74532025-08-12T22:51:51.414ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74542025-08-12T22:51:51.539ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "56e4db7e-d820-4951-b5d9-339bf9fce0f9", "date": "Tue, 12 Aug 2025 22:51:51 GMT"} })
74552025-08-12T22:51:51.539ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
74562025-08-12T22:51:51.539ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74572025-08-12T22:51:51.540ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "057eec50-e465-4269-9247-2c4bef4a3f7a", "content-length": "682", "date": "Tue, 12 Aug 2025 22:51:51 GMT"} })
74582025-08-12T22:51:51.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74592025-08-12T22:51:51.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74602025-08-12T22:51:51.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74612025-08-12T22:51:51.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74622025-08-12T22:51:51.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74632025-08-12T22:51:51.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74642025-08-12T22:51:51.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74652025-08-12T22:51:51.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74662025-08-12T22:51:51.555ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 507.132084ms iteration = 18 status = {}
74672025-08-12T22:51:51.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = afadc434-877f-4b84-8ba0-0b2fd0b59eed roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74682025-08-12T22:51:51.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = afadc434-877f-4b84-8ba0-0b2fd0b59eed resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74692025-08-12T22:51:51.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = afadc434-877f-4b84-8ba0-0b2fd0b59eed response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74702025-08-12T22:51:51.828ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 3
74712025-08-12T22:51:51.828ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221
74722025-08-12T22:51:51.858ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
74732025-08-12T22:51:51.858ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:50267
74742025-08-12T22:51:51.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50267 req_id = 09b92afe-c076-4acf-b14b-57decc4a5b42 roles = RoleSet { roles: {} } uri = /metrics/producers
74752025-08-12T22:51:51.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50267 req_id = 09b92afe-c076-4acf-b14b-57decc4a5b42 resource = Database result = Ok(()) uri = /metrics/producers
74762025-08-12T22:51:51.902ZINFOnexus: assigned collector to new producer collector_id = 4c467f25-cb67-42ad-b276-c490b467a350 file = nexus/src/app/oximeter.rs:76 producer_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
74772025-08-12T22:51:51.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 43619 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50267 req_id = 09b92afe-c076-4acf-b14b-57decc4a5b42 response_code = 201 uri = /metrics/producers
74782025-08-12T22:51:51.902ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "09b92afe-c076-4acf-b14b-57decc4a5b42", "content-length": "41", "date": "Tue, 12 Aug 2025 22:51:51 GMT"} })
74792025-08-12T22:51:51.904ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
74802025-08-12T22:51:52.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 539c4b5d-8834-4a57-b228-57f4589f80f6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74812025-08-12T22:51:52.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 539c4b5d-8834-4a57-b228-57f4589f80f6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74822025-08-12T22:51:52.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 539c4b5d-8834-4a57-b228-57f4589f80f6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74832025-08-12T22:51:53.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = afd405be-2029-43e3-b6d0-863ac4635a7b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74842025-08-12T22:51:53.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = afd405be-2029-43e3-b6d0-863ac4635a7b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74852025-08-12T22:51:53.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = afd405be-2029-43e3-b6d0-863ac4635a7b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74862025-08-12T22:51:54.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a81ca14f-cfb0-4fae-a780-a4ae4cb685e0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74872025-08-12T22:51:54.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a81ca14f-cfb0-4fae-a780-a4ae4cb685e0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74882025-08-12T22:51:54.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a81ca14f-cfb0-4fae-a780-a4ae4cb685e0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74892025-08-12T22:51:55.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3112cf1f-7081-4c72-8d6a-c68528a10d03 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74902025-08-12T22:51:55.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3112cf1f-7081-4c72-8d6a-c68528a10d03 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74912025-08-12T22:51:55.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3112cf1f-7081-4c72-8d6a-c68528a10d03 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
74922025-08-12T22:51:56.047ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 104 reason = Timeout
74932025-08-12T22:51:56.047ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
74942025-08-12T22:51:56.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
74952025-08-12T22:51:56.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74962025-08-12T22:51:56.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
74972025-08-12T22:51:56.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
74982025-08-12T22:51:56.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
74992025-08-12T22:51:56.054ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
75002025-08-12T22:51:56.054ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.701576ms iteration = 104 status = {"chicken_switches_updated":false}
75012025-08-12T22:51:56.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5a3e43e2-c611-4d53-b533-19d34a7215dd roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75022025-08-12T22:51:56.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5a3e43e2-c611-4d53-b533-19d34a7215dd resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75032025-08-12T22:51:56.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5a3e43e2-c611-4d53-b533-19d34a7215dd response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75042025-08-12T22:51:57.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dcd4ed9f-c3be-4172-b24b-3b2681d46142 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75052025-08-12T22:51:57.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dcd4ed9f-c3be-4172-b24b-3b2681d46142 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75062025-08-12T22:51:57.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dcd4ed9f-c3be-4172-b24b-3b2681d46142 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75072025-08-12T22:51:58.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3d301891-679a-44c7-9b86-f29885ed4b55 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75082025-08-12T22:51:58.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3d301891-679a-44c7-9b86-f29885ed4b55 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75092025-08-12T22:51:58.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3d301891-679a-44c7-9b86-f29885ed4b55 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75102025-08-12T22:51:58.835ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 608 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 5bbdf8d7-759b-4602-b1b8-4a90c104c546 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
75112025-08-12T22:51:59.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4d633ff1-16d3-41f5-88b7-0609b0a1c8b0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75122025-08-12T22:51:59.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4d633ff1-16d3-41f5-88b7-0609b0a1c8b0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75132025-08-12T22:51:59.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4d633ff1-16d3-41f5-88b7-0609b0a1c8b0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75142025-08-12T22:52:00.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c3815e11-2b9d-409a-bd79-91014a56b7a2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75152025-08-12T22:52:00.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c3815e11-2b9d-409a-bd79-91014a56b7a2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75162025-08-12T22:52:00.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c3815e11-2b9d-409a-bd79-91014a56b7a2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75172025-08-12T22:52:01.048ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
75182025-08-12T22:52:01.048ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
75192025-08-12T22:52:01.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75202025-08-12T22:52:01.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75212025-08-12T22:52:01.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 105 reason = Timeout
75222025-08-12T22:52:01.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
75232025-08-12T22:52:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75242025-08-12T22:52:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
75252025-08-12T22:52:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75262025-08-12T22:52:01.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75272025-08-12T22:52:01.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75282025-08-12T22:52:01.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75292025-08-12T22:52:01.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75302025-08-12T22:52:01.052ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.231582ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75312025-08-12T22:52:01.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
75322025-08-12T22:52:01.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
75332025-08-12T22:52:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75342025-08-12T22:52:01.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75352025-08-12T22:52:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
75362025-08-12T22:52:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75372025-08-12T22:52:01.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
75382025-08-12T22:52:01.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.027809ms iteration = 105 status = {"chicken_switches_updated":false}
75392025-08-12T22:52:01.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75402025-08-12T22:52:01.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75412025-08-12T22:52:01.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75422025-08-12T22:52:01.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
75432025-08-12T22:52:01.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75442025-08-12T22:52:01.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75452025-08-12T22:52:01.072ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
75462025-08-12T22:52:01.072ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.305409ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
75472025-08-12T22:52:01.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ca2465a9-2607-4fdd-a592-533f5f402f13 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75482025-08-12T22:52:01.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ca2465a9-2607-4fdd-a592-533f5f402f13 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75492025-08-12T22:52:01.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ca2465a9-2607-4fdd-a592-533f5f402f13 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75502025-08-12T22:52:02.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 90363dd0-ae45-401e-8a36-e96a4d483ad7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75512025-08-12T22:52:02.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 90363dd0-ae45-401e-8a36-e96a4d483ad7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75522025-08-12T22:52:02.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 90363dd0-ae45-401e-8a36-e96a4d483ad7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75532025-08-12T22:52:03.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2f043e51-a09b-4b64-9fa8-cba05356ace2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75542025-08-12T22:52:03.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2f043e51-a09b-4b64-9fa8-cba05356ace2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75552025-08-12T22:52:03.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2f043e51-a09b-4b64-9fa8-cba05356ace2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75562025-08-12T22:52:04.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fc3ee24a-d1dc-4116-a839-bc3705bedead roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75572025-08-12T22:52:04.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fc3ee24a-d1dc-4116-a839-bc3705bedead resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75582025-08-12T22:52:04.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fc3ee24a-d1dc-4116-a839-bc3705bedead response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75592025-08-12T22:52:05.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a3ddb8a2-937f-422c-8005-e1253a93694f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75602025-08-12T22:52:05.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a3ddb8a2-937f-422c-8005-e1253a93694f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75612025-08-12T22:52:05.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a3ddb8a2-937f-422c-8005-e1253a93694f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75622025-08-12T22:52:06.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 106 reason = Timeout
75632025-08-12T22:52:06.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
75642025-08-12T22:52:06.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
75652025-08-12T22:52:06.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75662025-08-12T22:52:06.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
75672025-08-12T22:52:06.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
75682025-08-12T22:52:06.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
75692025-08-12T22:52:06.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
75702025-08-12T22:52:06.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.762416ms iteration = 106 status = {"chicken_switches_updated":false}
75712025-08-12T22:52:06.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 63666b1c-2469-4343-b36f-b36e38e12409 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75722025-08-12T22:52:06.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 63666b1c-2469-4343-b36f-b36e38e12409 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75732025-08-12T22:52:06.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 63666b1c-2469-4343-b36f-b36e38e12409 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75742025-08-12T22:52:07.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9d84c14e-824e-4c09-b5cd-d47b09cffc17 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75752025-08-12T22:52:07.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9d84c14e-824e-4c09-b5cd-d47b09cffc17 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75762025-08-12T22:52:07.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9d84c14e-824e-4c09-b5cd-d47b09cffc17 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75772025-08-12T22:52:08.835ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 556 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = ef3129a1-8292-4051-a379-385eaa1c2cc7 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
75782025-08-12T22:52:08.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a2c41980-5915-49af-9e9f-397e128d5dde roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75792025-08-12T22:52:08.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a2c41980-5915-49af-9e9f-397e128d5dde resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75802025-08-12T22:52:08.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a2c41980-5915-49af-9e9f-397e128d5dde response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75812025-08-12T22:52:09.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5b150c3f-ac20-4589-9132-2ace83fb777e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75822025-08-12T22:52:09.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5b150c3f-ac20-4589-9132-2ace83fb777e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75832025-08-12T22:52:09.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5b150c3f-ac20-4589-9132-2ace83fb777e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75842025-08-12T22:52:10.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 55d37abf-c0dd-46d9-852f-908a68dbc286 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75852025-08-12T22:52:10.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 55d37abf-c0dd-46d9-852f-908a68dbc286 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75862025-08-12T22:52:11.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 55d37abf-c0dd-46d9-852f-908a68dbc286 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
75872025-08-12T22:52:11.048ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
75882025-08-12T22:52:11.048ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
75892025-08-12T22:52:11.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75902025-08-12T22:52:11.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75912025-08-12T22:52:11.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 107 reason = Timeout
75922025-08-12T22:52:11.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
75932025-08-12T22:52:11.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75942025-08-12T22:52:11.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75952025-08-12T22:52:11.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
75962025-08-12T22:52:11.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75972025-08-12T22:52:11.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75982025-08-12T22:52:11.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75992025-08-12T22:52:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76002025-08-12T22:52:11.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.694406ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76012025-08-12T22:52:11.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76022025-08-12T22:52:11.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76032025-08-12T22:52:11.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
76042025-08-12T22:52:11.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
76052025-08-12T22:52:11.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76062025-08-12T22:52:11.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
76072025-08-12T22:52:11.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
76082025-08-12T22:52:11.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.439503ms iteration = 107 status = {"chicken_switches_updated":false}
76092025-08-12T22:52:11.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76102025-08-12T22:52:11.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76112025-08-12T22:52:11.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76122025-08-12T22:52:11.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
76132025-08-12T22:52:11.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76142025-08-12T22:52:11.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76152025-08-12T22:52:11.072ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
76162025-08-12T22:52:11.072ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.380659ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
76172025-08-12T22:52:12.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cb7223b7-2083-41f9-8a58-ad12c383bd8b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76182025-08-12T22:52:12.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cb7223b7-2083-41f9-8a58-ad12c383bd8b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76192025-08-12T22:52:12.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cb7223b7-2083-41f9-8a58-ad12c383bd8b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76202025-08-12T22:52:13.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f197e319-23ab-40b5-af78-a4bea6572572 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76212025-08-12T22:52:13.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f197e319-23ab-40b5-af78-a4bea6572572 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76222025-08-12T22:52:13.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f197e319-23ab-40b5-af78-a4bea6572572 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76232025-08-12T22:52:14.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 57924354-ffbe-4a33-b47e-b4b9009d5a78 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76242025-08-12T22:52:14.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 57924354-ffbe-4a33-b47e-b4b9009d5a78 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76252025-08-12T22:52:14.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 57924354-ffbe-4a33-b47e-b4b9009d5a78 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76262025-08-12T22:52:15.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 21f222a5-683e-4570-8564-e77f08a74c3a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76272025-08-12T22:52:15.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 21f222a5-683e-4570-8564-e77f08a74c3a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76282025-08-12T22:52:15.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 21f222a5-683e-4570-8564-e77f08a74c3a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76292025-08-12T22:52:16.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 108 reason = Timeout
76302025-08-12T22:52:16.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
76312025-08-12T22:52:16.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
76322025-08-12T22:52:16.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76332025-08-12T22:52:16.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
76342025-08-12T22:52:16.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
76352025-08-12T22:52:16.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
76362025-08-12T22:52:16.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
76372025-08-12T22:52:16.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.10949ms iteration = 108 status = {"chicken_switches_updated":false}
76382025-08-12T22:52:16.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9ebbe5df-b1da-4f4a-bf7c-26f7988b42be roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76392025-08-12T22:52:16.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9ebbe5df-b1da-4f4a-bf7c-26f7988b42be resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76402025-08-12T22:52:16.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9ebbe5df-b1da-4f4a-bf7c-26f7988b42be response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76412025-08-12T22:52:17.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a5b788f5-36c9-430d-b6c3-b3137e44faf5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76422025-08-12T22:52:17.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a5b788f5-36c9-430d-b6c3-b3137e44faf5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76432025-08-12T22:52:17.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a5b788f5-36c9-430d-b6c3-b3137e44faf5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76442025-08-12T22:52:18.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 091e6b13-65b7-44a2-84de-1c7d38b9dd34 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76452025-08-12T22:52:18.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 091e6b13-65b7-44a2-84de-1c7d38b9dd34 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76462025-08-12T22:52:18.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 091e6b13-65b7-44a2-84de-1c7d38b9dd34 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76472025-08-12T22:52:18.835ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 486 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = a973682c-3ec0-48c7-9875-704f45a3afbe response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
76482025-08-12T22:52:19.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 34e781e8-c434-42f7-84e0-94e5d9c007a7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76492025-08-12T22:52:19.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 34e781e8-c434-42f7-84e0-94e5d9c007a7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76502025-08-12T22:52:19.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 34e781e8-c434-42f7-84e0-94e5d9c007a7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76512025-08-12T22:52:20.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8577f934-f796-4d67-bc11-4bb3a7d29244 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76522025-08-12T22:52:20.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8577f934-f796-4d67-bc11-4bb3a7d29244 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76532025-08-12T22:52:20.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8577f934-f796-4d67-bc11-4bb3a7d29244 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
76542025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
76552025-08-12T22:52:21.047ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0
76562025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.7\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0"}
76572025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
76582025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
76592025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
76602025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
76612025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76622025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76632025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
76642025-08-12T22:52:21.047ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-12 22:42:21.047168457 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
76652025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
76662025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
76672025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
76682025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
76692025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76702025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
76712025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
76722025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
76732025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76742025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
76752025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
76762025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76772025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76782025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
76792025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76802025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76812025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
76822025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
76832025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76842025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76852025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
76862025-08-12T22:52:21.047ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
76872025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76882025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 10 reason = Timeout
76892025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
76902025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 10 reason = Timeout
76912025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
76922025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
76932025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
76942025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76952025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
76962025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76972025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76982025-08-12T22:52:21.047ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3e3264d-303d-4ce7-a0ce-0090b10b154f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1543, tv_nsec: 281746003 } })
76992025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
77002025-08-12T22:52:21.047ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("043b8097-0e38-4228-bada-dac70e518148.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26cd5275-57f5-4466-a94f-f96956f55588.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1543, tv_nsec: 281741683 } })
77012025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
77022025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 13 reason = Timeout
77032025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
77042025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
77052025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
77062025-08-12T22:52:21.047ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 36.37\u{b5}s iteration = 13 status = "Disabled"
77072025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
77082025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77092025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
77102025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
77112025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
77122025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
77132025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
77142025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
77152025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 19 reason = Timeout
77162025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
77172025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 9.45\u{b5}s iteration = 19 status = {"disabled":true,"errors":[],"sps":[]}
77182025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
77192025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
77202025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77212025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 109 reason = Timeout
77222025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
77232025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
77242025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
77252025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
77262025-08-12T22:52:21.048ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
77272025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77282025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77292025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77302025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
77312025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77322025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
77332025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
77342025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77352025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77362025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
77372025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
77382025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77392025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
77402025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77412025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
77422025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77432025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
77442025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77452025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77462025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
77472025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
77482025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77492025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
77502025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
77512025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77522025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77532025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77542025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77552025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
77562025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
77572025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
77582025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
77592025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
77602025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
77612025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77622025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.359024ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
77632025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77642025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77652025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77662025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77672025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77682025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77692025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77702025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
77712025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.415594ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
77722025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77732025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77742025-08-12T22:52:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77752025-08-12T22:52:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77762025-08-12T22:52:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77772025-08-12T22:52:21.049ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77782025-08-12T22:52:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77792025-08-12T22:52:21.049ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77802025-08-12T22:52:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77812025-08-12T22:52:21.049ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77822025-08-12T22:52:21.050ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1543, tv_nsec: 284100626 } })
77832025-08-12T22:52:21.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77842025-08-12T22:52:21.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.565136ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
77852025-08-12T22:52:21.050ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
77862025-08-12T22:52:21.050ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-12 22:42:21.047168457 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
77872025-08-12T22:52:21.050ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77882025-08-12T22:52:21.050ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.612545ms iteration = 10 status = {"expiration":"2025-08-12T22:42:21.047168457Z","pruned":[]}
77892025-08-12T22:52:21.051ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1543, tv_nsec: 284967974 } })
77902025-08-12T22:52:21.051ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77912025-08-12T22:52:21.051ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
77922025-08-12T22:52:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.578894ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
77932025-08-12T22:52:21.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77942025-08-12T22:52:21.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77952025-08-12T22:52:21.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77962025-08-12T22:52:21.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77972025-08-12T22:52:21.053ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
77982025-08-12T22:52:21.054ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77992025-08-12T22:52:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
78002025-08-12T22:52:21.054ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78012025-08-12T22:52:21.054ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78022025-08-12T22:52:21.054ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
78032025-08-12T22:52:21.054ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78042025-08-12T22:52:21.054ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.869867ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
78052025-08-12T22:52:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78062025-08-12T22:52:21.055ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78072025-08-12T22:52:21.055ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78082025-08-12T22:52:21.055ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78092025-08-12T22:52:21.055ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78102025-08-12T22:52:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78112025-08-12T22:52:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
78122025-08-12T22:52:21.055ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
78132025-08-12T22:52:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
78142025-08-12T22:52:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78152025-08-12T22:52:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
78162025-08-12T22:52:21.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78172025-08-12T22:52:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78182025-08-12T22:52:21.056ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78192025-08-12T22:52:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78202025-08-12T22:52:21.056ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
78212025-08-12T22:52:21.056ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 9.000689ms iteration = 10 status = {"by_rx":{},"error":null}
78222025-08-12T22:52:21.056ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 9.19861ms iteration = 10 status = {"dispatched":[],"errors":[],"glob_version":"180.0.0","globs_reprocessed":{},"no_receivers":[]}
78232025-08-12T22:52:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78242025-08-12T22:52:21.057ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78252025-08-12T22:52:21.057ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78262025-08-12T22:52:21.057ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78272025-08-12T22:52:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78282025-08-12T22:52:21.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78292025-08-12T22:52:21.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78302025-08-12T22:52:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78312025-08-12T22:52:21.058ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78322025-08-12T22:52:21.058ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78332025-08-12T22:52:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
78342025-08-12T22:52:21.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78352025-08-12T22:52:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78362025-08-12T22:52:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78372025-08-12T22:52:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78382025-08-12T22:52:21.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78392025-08-12T22:52:21.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78402025-08-12T22:52:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78412025-08-12T22:52:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78422025-08-12T22:52:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
78432025-08-12T22:52:21.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78442025-08-12T22:52:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78452025-08-12T22:52:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
78462025-08-12T22:52:21.060ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
78472025-08-12T22:52:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78482025-08-12T22:52:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
78492025-08-12T22:52:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
78502025-08-12T22:52:21.060ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78512025-08-12T22:52:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78522025-08-12T22:52:21.064ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78532025-08-12T22:52:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78542025-08-12T22:52:21.066ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78552025-08-12T22:52:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78562025-08-12T22:52:21.066ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78572025-08-12T22:52:21.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78582025-08-12T22:52:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78592025-08-12T22:52:21.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78602025-08-12T22:52:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78612025-08-12T22:52:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
78622025-08-12T22:52:21.070ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78632025-08-12T22:52:21.072ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78642025-08-12T22:52:21.072ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78652025-08-12T22:52:21.072ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 24.43663ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78662025-08-12T22:52:21.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78672025-08-12T22:52:21.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78682025-08-12T22:52:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78692025-08-12T22:52:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78702025-08-12T22:52:21.080ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78712025-08-12T22:52:21.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78722025-08-12T22:52:21.082ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1543, tv_nsec: 316447103 } })
78732025-08-12T22:52:21.082ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
78742025-08-12T22:52:21.112ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78752025-08-12T22:52:21.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78762025-08-12T22:52:21.115ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78772025-08-12T22:52:21.115ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
78782025-08-12T22:52:21.116ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 68.044258ms iteration = 109 status = {"chicken_switches_updated":false}
78792025-08-12T22:52:21.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78802025-08-12T22:52:21.119ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 71.583202ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
78812025-08-12T22:52:21.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78822025-08-12T22:52:21.121ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
78832025-08-12T22:52:21.121ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
78842025-08-12T22:52:21.121ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.3572ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
78852025-08-12T22:52:21.121ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78862025-08-12T22:52:21.121ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
78872025-08-12T22:52:21.121ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
78882025-08-12T22:52:21.121ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
78892025-08-12T22:52:21.121ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78902025-08-12T22:52:21.122ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78912025-08-12T22:52:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78922025-08-12T22:52:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78932025-08-12T22:52:21.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78942025-08-12T22:52:21.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78952025-08-12T22:52:21.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78962025-08-12T22:52:21.124ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78972025-08-12T22:52:21.124ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78982025-08-12T22:52:21.124ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78992025-08-12T22:52:21.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79002025-08-12T22:52:21.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79012025-08-12T22:52:21.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79022025-08-12T22:52:21.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79032025-08-12T22:52:21.124ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
79042025-08-12T22:52:21.125ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
79052025-08-12T22:52:21.125ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.267108ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
79062025-08-12T22:52:21.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 77.42831ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
79072025-08-12T22:52:21.125ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79082025-08-12T22:52:21.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79092025-08-12T22:52:21.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79102025-08-12T22:52:21.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79112025-08-12T22:52:21.127ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 79.47676ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
79122025-08-12T22:52:21.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
79132025-08-12T22:52:21.127ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
79142025-08-12T22:52:21.127ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79152025-08-12T22:52:21.127ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79162025-08-12T22:52:21.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79172025-08-12T22:52:21.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
79182025-08-12T22:52:21.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79192025-08-12T22:52:21.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79202025-08-12T22:52:21.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79212025-08-12T22:52:21.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79222025-08-12T22:52:21.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79232025-08-12T22:52:21.130ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
79242025-08-12T22:52:21.130ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
79252025-08-12T22:52:21.130ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
79262025-08-12T22:52:21.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79272025-08-12T22:52:21.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79282025-08-12T22:52:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
79292025-08-12T22:52:21.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79302025-08-12T22:52:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79312025-08-12T22:52:21.131ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79322025-08-12T22:52:21.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79332025-08-12T22:52:21.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
79342025-08-12T22:52:21.134ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
79352025-08-12T22:52:21.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
79362025-08-12T22:52:21.135ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 87.626469ms iteration = 21 status = {"physical_disks_added":0}
79372025-08-12T22:52:21.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79382025-08-12T22:52:21.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79392025-08-12T22:52:21.135ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79402025-08-12T22:52:21.135ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.952873ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79412025-08-12T22:52:21.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79422025-08-12T22:52:21.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79432025-08-12T22:52:21.136ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 88.834471ms iteration = 5 status = {"nsuccess":5}
79442025-08-12T22:52:21.137ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79452025-08-12T22:52:21.137ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
79462025-08-12T22:52:21.137ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
79472025-08-12T22:52:21.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79482025-08-12T22:52:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79492025-08-12T22:52:21.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79502025-08-12T22:52:21.140ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
79512025-08-12T22:52:21.140ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79522025-08-12T22:52:21.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79532025-08-12T22:52:21.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79542025-08-12T22:52:21.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79552025-08-12T22:52:21.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79562025-08-12T22:52:21.145ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
79572025-08-12T22:52:21.145ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
79582025-08-12T22:52:21.145ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-12 22:43:49.909589 UTC dns_group = internal generation = 1
79592025-08-12T22:52:21.145ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 98.450986ms iteration = 10 status = {"generation":1}
79602025-08-12T22:52:21.146ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
79612025-08-12T22:52:21.146ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 98.590367ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
79622025-08-12T22:52:21.160ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
79632025-08-12T22:52:21.160ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 112.416853ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
79642025-08-12T22:52:21.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 91d4c6d9-dcbd-4aee-9a9e-2be8e48d83ac roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
79652025-08-12T22:52:21.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 91d4c6d9-dcbd-4aee-9a9e-2be8e48d83ac resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
79662025-08-12T22:52:21.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 91d4c6d9-dcbd-4aee-9a9e-2be8e48d83ac response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
79672025-08-12T22:52:21.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.053606ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79682025-08-12T22:52:21.177ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79692025-08-12T22:52:21.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79702025-08-12T22:52:21.179ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79712025-08-12T22:52:21.179ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79722025-08-12T22:52:21.179ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
79732025-08-12T22:52:21.179ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 0 version = 2
79742025-08-12T22:52:21.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79752025-08-12T22:52:21.180ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 132.027965ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79762025-08-12T22:52:21.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79772025-08-12T22:52:21.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79782025-08-12T22:52:21.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
79792025-08-12T22:52:21.181ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79802025-08-12T22:52:21.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79812025-08-12T22:52:21.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
79822025-08-12T22:52:21.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79832025-08-12T22:52:21.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79842025-08-12T22:52:21.183ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
79852025-08-12T22:52:21.183ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 135.538159ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
79862025-08-12T22:52:21.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79872025-08-12T22:52:21.184ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79882025-08-12T22:52:21.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79892025-08-12T22:52:21.185ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 137.614529ms iteration = 19 status = 0
79902025-08-12T22:52:21.187ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 4 version = 2
79912025-08-12T22:52:21.187ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
79922025-08-12T22:52:21.187ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-12 22:43:50.527483 UTC dns_group = external generation = 2
79932025-08-12T22:52:21.187ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 139.911133ms iteration = 10 status = {"generation":2}
79942025-08-12T22:52:21.203ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-12T22:43:09.981233Z, time_modified: 2025-08-12T22:43:09.981233Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }) }
79952025-08-12T22:52:21.203ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 156.006331ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]}},"default_endpoint":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
79962025-08-12T22:52:21.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79972025-08-12T22:52:21.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79982025-08-12T22:52:21.213ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
79992025-08-12T22:52:21.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80002025-08-12T22:52:21.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
80012025-08-12T22:52:21.218ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
80022025-08-12T22:52:21.218ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80032025-08-12T22:52:21.218ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bdb9e16-c02c-4236-94c5-0bdd69cc3aef", "content-length": "26", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} })
80042025-08-12T22:52:21.218ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80052025-08-12T22:52:21.220ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80062025-08-12T22:52:21.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80072025-08-12T22:52:21.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80082025-08-12T22:52:21.222ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80092025-08-12T22:52:21.227ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80102025-08-12T22:52:21.227ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80112025-08-12T22:52:21.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80122025-08-12T22:52:21.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80132025-08-12T22:52:21.231ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80142025-08-12T22:52:21.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80152025-08-12T22:52:21.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80162025-08-12T22:52:21.247ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
80172025-08-12T22:52:21.247ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80182025-08-12T22:52:21.248ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "40185e60-86cf-4186-a252-3b13ee5a5198", "content-length": "26", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} })
80192025-08-12T22:52:21.248ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80202025-08-12T22:52:21.249ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
80212025-08-12T22:52:21.332ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
80222025-08-12T22:52:21.332ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 284.717562ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
80232025-08-12T22:52:21.352ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
80242025-08-12T22:52:21.353ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
80252025-08-12T22:52:21.353ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80262025-08-12T22:52:21.353ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "09a6457d-5761-4540-932b-92ae48e52f97", "content-length": "26", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} })
80272025-08-12T22:52:21.353ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80282025-08-12T22:52:21.354ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80292025-08-12T22:52:21.440ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
80302025-08-12T22:52:21.477ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
80312025-08-12T22:52:21.478ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "70c90b8c-e1f8-46bb-b7b7-cc2feec858b5", "content-length": "691", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} })
80322025-08-12T22:52:21.478ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
80332025-08-12T22:52:21.478ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
80342025-08-12T22:52:21.478ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
80352025-08-12T22:52:21.480ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 432.30021ms iteration = 19 status = {}
80362025-08-12T22:52:21.564ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 517.387265ms iteration = 19 status = {}
80372025-08-12T22:52:21.581ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80382025-08-12T22:52:21.581ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80392025-08-12T22:52:21.582ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "59937fc5-4b34-420d-b203-1bf8a3032c80", "content-length": "372", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} })
80402025-08-12T22:52:21.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80412025-08-12T22:52:21.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80422025-08-12T22:52:21.597ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
80432025-08-12T22:52:21.597ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80442025-08-12T22:52:21.598ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c61d0ee8-5d3a-433d-aaeb-f408342f75b0", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} })
80452025-08-12T22:52:21.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80462025-08-12T22:52:21.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80472025-08-12T22:52:21.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80482025-08-12T22:52:21.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80492025-08-12T22:52:21.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80502025-08-12T22:52:21.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80512025-08-12T22:52:21.609ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80522025-08-12T22:52:21.609ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80532025-08-12T22:52:21.609ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3215ffb6-3ad2-4d7c-8da6-de060907c757", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} })
80542025-08-12T22:52:21.611ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 563.517307ms iteration = 19 status = {}
80552025-08-12T22:52:21.615ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
80562025-08-12T22:52:21.616ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8a3a6858-4654-4222-a3ab-3a04265592c0", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80572025-08-12T22:52:21.616ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80582025-08-12T22:52:21.618ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "619453ce-11aa-436c-875d-2716e8fd2454", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80592025-08-12T22:52:21.618ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80602025-08-12T22:52:21.620ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "de029828-91a4-41d2-8078-10ef287eaa3d", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80612025-08-12T22:52:21.620ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80622025-08-12T22:52:21.622ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80632025-08-12T22:52:21.622ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 575.308612ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
80642025-08-12T22:52:21.644ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80652025-08-12T22:52:21.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80662025-08-12T22:52:21.646ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 599.404909ms iteration = 19 status = null
80672025-08-12T22:52:21.649ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
80682025-08-12T22:52:21.649ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "776d94f3-7b41-48e5-94bc-66beb5daf8bf", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80692025-08-12T22:52:21.649ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80702025-08-12T22:52:21.651ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "20023137-8ace-4ca7-b8c6-519120115c3b", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80712025-08-12T22:52:21.651ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80722025-08-12T22:52:21.653ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80732025-08-12T22:52:21.653ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 606.472098ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
80742025-08-12T22:52:21.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80752025-08-12T22:52:21.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80762025-08-12T22:52:21.673ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
80772025-08-12T22:52:21.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80782025-08-12T22:52:21.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80792025-08-12T22:52:21.686ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
80802025-08-12T22:52:21.687ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
80812025-08-12T22:52:21.687ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80822025-08-12T22:52:21.687ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80832025-08-12T22:52:21.687ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80842025-08-12T22:52:21.687ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80852025-08-12T22:52:21.687ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80862025-08-12T22:52:21.687ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80872025-08-12T22:52:21.687ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80882025-08-12T22:52:21.687ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80892025-08-12T22:52:21.687ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
80902025-08-12T22:52:21.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80912025-08-12T22:52:21.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80922025-08-12T22:52:21.690ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
80932025-08-12T22:52:21.690ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
80942025-08-12T22:52:21.794ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "36f77726-e5ef-46ac-8b06-2546a56ad22b", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} })
80952025-08-12T22:52:21.794ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
80962025-08-12T22:52:21.794ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80972025-08-12T22:52:21.800ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "22c03e7b-4491-4c3b-a067-50e29d39a683", "content-length": "682", "date": "Tue, 12 Aug 2025 22:52:21 GMT"} })
80982025-08-12T22:52:21.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80992025-08-12T22:52:21.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81002025-08-12T22:52:21.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81012025-08-12T22:52:21.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81022025-08-12T22:52:21.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81032025-08-12T22:52:21.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81042025-08-12T22:52:21.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81052025-08-12T22:52:21.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81062025-08-12T22:52:21.817ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 769.350525ms iteration = 19 status = {}
81072025-08-12T22:52:22.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c1ae5e7b-dd25-4c00-bddd-8ec5a68da287 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81082025-08-12T22:52:22.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c1ae5e7b-dd25-4c00-bddd-8ec5a68da287 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81092025-08-12T22:52:22.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c1ae5e7b-dd25-4c00-bddd-8ec5a68da287 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81102025-08-12T22:52:23.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc2472ce-26bd-4b47-8d0f-fdf1197bd844 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81112025-08-12T22:52:23.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc2472ce-26bd-4b47-8d0f-fdf1197bd844 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81122025-08-12T22:52:23.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bc2472ce-26bd-4b47-8d0f-fdf1197bd844 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81132025-08-12T22:52:24.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c7fac6bc-588f-4dc2-836d-36acd65be199 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81142025-08-12T22:52:24.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c7fac6bc-588f-4dc2-836d-36acd65be199 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81152025-08-12T22:52:24.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c7fac6bc-588f-4dc2-836d-36acd65be199 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81162025-08-12T22:52:25.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 53334ef9-a4b7-46fe-b778-7ea338599290 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81172025-08-12T22:52:25.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 53334ef9-a4b7-46fe-b778-7ea338599290 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81182025-08-12T22:52:25.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 53334ef9-a4b7-46fe-b778-7ea338599290 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81192025-08-12T22:52:26.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 110 reason = Timeout
81202025-08-12T22:52:26.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
81212025-08-12T22:52:26.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
81222025-08-12T22:52:26.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81232025-08-12T22:52:26.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
81242025-08-12T22:52:26.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
81252025-08-12T22:52:26.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
81262025-08-12T22:52:26.054ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
81272025-08-12T22:52:26.054ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 5.884758ms iteration = 110 status = {"chicken_switches_updated":false}
81282025-08-12T22:52:26.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ad8feb25-dfc1-41f7-8138-bb506f81dd41 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81292025-08-12T22:52:26.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ad8feb25-dfc1-41f7-8138-bb506f81dd41 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81302025-08-12T22:52:26.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ad8feb25-dfc1-41f7-8138-bb506f81dd41 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81312025-08-12T22:52:27.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9b7e103f-4aed-409b-8c02-b5a5cf668eb0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81322025-08-12T22:52:27.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9b7e103f-4aed-409b-8c02-b5a5cf668eb0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81332025-08-12T22:52:27.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9b7e103f-4aed-409b-8c02-b5a5cf668eb0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81342025-08-12T22:52:28.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 310dce25-7ed3-423c-9960-530e3549f628 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81352025-08-12T22:52:28.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 310dce25-7ed3-423c-9960-530e3549f628 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81362025-08-12T22:52:28.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 310dce25-7ed3-423c-9960-530e3549f628 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81372025-08-12T22:52:28.822ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:57540
81382025-08-12T22:52:28.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57540 req_id = 12e2aa65-91b1-438e-8820-b72e4ee221f0 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
81392025-08-12T22:52:28.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57540 req_id = 12e2aa65-91b1-438e-8820-b72e4ee221f0 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
81402025-08-12T22:52:28.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57540 req_id = 12e2aa65-91b1-438e-8820-b72e4ee221f0 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
81412025-08-12T22:52:28.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57540 req_id = e30b02f4-bc7f-4fd2-9f56-ffd1973fdae1 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
81422025-08-12T22:52:28.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57540 req_id = e30b02f4-bc7f-4fd2-9f56-ffd1973fdae1 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
81432025-08-12T22:52:28.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57540 req_id = e30b02f4-bc7f-4fd2-9f56-ffd1973fdae1 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
81442025-08-12T22:52:28.836ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 611 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 6ccd6339-8e74-4e76-a9e6-1e78f81af0ad response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
81452025-08-12T22:52:29.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2da063bc-69fd-4534-897c-8261e5d24472 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81462025-08-12T22:52:29.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2da063bc-69fd-4534-897c-8261e5d24472 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81472025-08-12T22:52:29.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2da063bc-69fd-4534-897c-8261e5d24472 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81482025-08-12T22:52:30.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d844eaa2-b11b-4219-9cc2-37c62a677b5f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81492025-08-12T22:52:30.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d844eaa2-b11b-4219-9cc2-37c62a677b5f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81502025-08-12T22:52:30.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d844eaa2-b11b-4219-9cc2-37c62a677b5f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81512025-08-12T22:52:31.048ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
81522025-08-12T22:52:31.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81532025-08-12T22:52:31.048ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
81542025-08-12T22:52:31.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 111 reason = Timeout
81552025-08-12T22:52:31.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81562025-08-12T22:52:31.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
81572025-08-12T22:52:31.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81582025-08-12T22:52:31.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81592025-08-12T22:52:31.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
81602025-08-12T22:52:31.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81612025-08-12T22:52:31.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81622025-08-12T22:52:31.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81632025-08-12T22:52:31.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81642025-08-12T22:52:31.052ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.122001ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81652025-08-12T22:52:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
81662025-08-12T22:52:31.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
81672025-08-12T22:52:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
81682025-08-12T22:52:31.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81692025-08-12T22:52:31.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81702025-08-12T22:52:31.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81712025-08-12T22:52:31.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
81722025-08-12T22:52:31.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.308522ms iteration = 111 status = {"chicken_switches_updated":false}
81732025-08-12T22:52:31.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81742025-08-12T22:52:31.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81752025-08-12T22:52:31.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81762025-08-12T22:52:31.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
81772025-08-12T22:52:31.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81782025-08-12T22:52:31.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81792025-08-12T22:52:31.073ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
81802025-08-12T22:52:31.073ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.920224ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
81812025-08-12T22:52:31.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fe5e20b1-a21c-498f-9b88-abf911864929 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81822025-08-12T22:52:31.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fe5e20b1-a21c-498f-9b88-abf911864929 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81832025-08-12T22:52:31.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fe5e20b1-a21c-498f-9b88-abf911864929 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81842025-08-12T22:52:32.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c67a7bce-4198-408b-aaae-264087a4ce3d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81852025-08-12T22:52:32.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c67a7bce-4198-408b-aaae-264087a4ce3d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81862025-08-12T22:52:32.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c67a7bce-4198-408b-aaae-264087a4ce3d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81872025-08-12T22:52:33.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3220d8ff-fa91-4167-8084-10ac9cc05435 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81882025-08-12T22:52:33.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3220d8ff-fa91-4167-8084-10ac9cc05435 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81892025-08-12T22:52:33.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3220d8ff-fa91-4167-8084-10ac9cc05435 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81902025-08-12T22:52:34.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f5e15a6a-f3e8-4541-9fcd-052a529efb23 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81912025-08-12T22:52:34.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f5e15a6a-f3e8-4541-9fcd-052a529efb23 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81922025-08-12T22:52:34.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f5e15a6a-f3e8-4541-9fcd-052a529efb23 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81932025-08-12T22:52:35.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0333e6e6-2957-4518-a8e3-5c15d912426f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81942025-08-12T22:52:35.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0333e6e6-2957-4518-a8e3-5c15d912426f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81952025-08-12T22:52:35.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0333e6e6-2957-4518-a8e3-5c15d912426f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
81962025-08-12T22:52:36.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 112 reason = Timeout
81972025-08-12T22:52:36.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
81982025-08-12T22:52:36.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
81992025-08-12T22:52:36.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82002025-08-12T22:52:36.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
82012025-08-12T22:52:36.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
82022025-08-12T22:52:36.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
82032025-08-12T22:52:36.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
82042025-08-12T22:52:36.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.310782ms iteration = 112 status = {"chicken_switches_updated":false}
82052025-08-12T22:52:36.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4f66a954-97e5-43c7-be8c-de6b1b3db975 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82062025-08-12T22:52:36.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4f66a954-97e5-43c7-be8c-de6b1b3db975 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82072025-08-12T22:52:36.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4f66a954-97e5-43c7-be8c-de6b1b3db975 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82082025-08-12T22:52:37.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 771d51e5-d799-4d06-bb42-58f387486d8a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82092025-08-12T22:52:37.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 771d51e5-d799-4d06-bb42-58f387486d8a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82102025-08-12T22:52:37.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 771d51e5-d799-4d06-bb42-58f387486d8a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82112025-08-12T22:52:38.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b790ca83-aab2-4ffd-a57d-6dfc9d1ede55 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82122025-08-12T22:52:38.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b790ca83-aab2-4ffd-a57d-6dfc9d1ede55 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82132025-08-12T22:52:38.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b790ca83-aab2-4ffd-a57d-6dfc9d1ede55 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82142025-08-12T22:52:38.836ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 588 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = b0b1640f-0059-4011-8fa6-8c343c6b61a9 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
82152025-08-12T22:52:39.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c55d1a91-cd73-408d-80c8-8fd0fc28abc0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82162025-08-12T22:52:39.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c55d1a91-cd73-408d-80c8-8fd0fc28abc0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82172025-08-12T22:52:39.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c55d1a91-cd73-408d-80c8-8fd0fc28abc0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82182025-08-12T22:52:40.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e9cbda0d-bcd7-4a4b-9f77-e7d3ea6a87ef roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82192025-08-12T22:52:40.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e9cbda0d-bcd7-4a4b-9f77-e7d3ea6a87ef resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82202025-08-12T22:52:40.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e9cbda0d-bcd7-4a4b-9f77-e7d3ea6a87ef response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82212025-08-12T22:52:41.048ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
82222025-08-12T22:52:41.048ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
82232025-08-12T22:52:41.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82242025-08-12T22:52:41.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82252025-08-12T22:52:41.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 113 reason = Timeout
82262025-08-12T22:52:41.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
82272025-08-12T22:52:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82282025-08-12T22:52:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82292025-08-12T22:52:41.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
82302025-08-12T22:52:41.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82312025-08-12T22:52:41.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82322025-08-12T22:52:41.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82332025-08-12T22:52:41.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82342025-08-12T22:52:41.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.868728ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82352025-08-12T22:52:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
82362025-08-12T22:52:41.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
82372025-08-12T22:52:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
82382025-08-12T22:52:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82392025-08-12T22:52:41.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82402025-08-12T22:52:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82412025-08-12T22:52:41.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
82422025-08-12T22:52:41.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.264431ms iteration = 113 status = {"chicken_switches_updated":false}
82432025-08-12T22:52:41.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82442025-08-12T22:52:41.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82452025-08-12T22:52:41.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82462025-08-12T22:52:41.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
82472025-08-12T22:52:41.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82482025-08-12T22:52:41.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82492025-08-12T22:52:41.072ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
82502025-08-12T22:52:41.072ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.066706ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
82512025-08-12T22:52:41.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f403839a-dd01-4f1e-ac46-34bc5f7784d4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82522025-08-12T22:52:41.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f403839a-dd01-4f1e-ac46-34bc5f7784d4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82532025-08-12T22:52:41.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f403839a-dd01-4f1e-ac46-34bc5f7784d4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82542025-08-12T22:52:42.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0681f185-392f-4e20-ae4f-b2e14a88b9ad roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82552025-08-12T22:52:42.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0681f185-392f-4e20-ae4f-b2e14a88b9ad resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82562025-08-12T22:52:42.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0681f185-392f-4e20-ae4f-b2e14a88b9ad response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82572025-08-12T22:52:43.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 996ca5ce-6f8a-4569-bb00-1f5a638efef7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82582025-08-12T22:52:43.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 996ca5ce-6f8a-4569-bb00-1f5a638efef7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82592025-08-12T22:52:43.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 996ca5ce-6f8a-4569-bb00-1f5a638efef7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82602025-08-12T22:52:44.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 41d860c2-d0bc-4728-aeff-a74086b9de60 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82612025-08-12T22:52:44.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 41d860c2-d0bc-4728-aeff-a74086b9de60 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82622025-08-12T22:52:44.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 41d860c2-d0bc-4728-aeff-a74086b9de60 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82632025-08-12T22:52:45.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 662eb022-c0bf-4f6b-ab5a-5a8638723c06 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82642025-08-12T22:52:45.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 662eb022-c0bf-4f6b-ab5a-5a8638723c06 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82652025-08-12T22:52:45.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 662eb022-c0bf-4f6b-ab5a-5a8638723c06 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82662025-08-12T22:52:46.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 114 reason = Timeout
82672025-08-12T22:52:46.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
82682025-08-12T22:52:46.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
82692025-08-12T22:52:46.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82702025-08-12T22:52:46.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
82712025-08-12T22:52:46.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
82722025-08-12T22:52:46.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
82732025-08-12T22:52:46.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
82742025-08-12T22:52:46.056ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.630225ms iteration = 114 status = {"chicken_switches_updated":false}
82752025-08-12T22:52:46.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 864318c0-f36c-4ae1-93b7-0faaff6c31e3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82762025-08-12T22:52:46.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 864318c0-f36c-4ae1-93b7-0faaff6c31e3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82772025-08-12T22:52:46.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 864318c0-f36c-4ae1-93b7-0faaff6c31e3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82782025-08-12T22:52:47.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 20da567d-39d0-43b1-9330-dabc7db9fc10 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82792025-08-12T22:52:47.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 20da567d-39d0-43b1-9330-dabc7db9fc10 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82802025-08-12T22:52:47.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 20da567d-39d0-43b1-9330-dabc7db9fc10 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82812025-08-12T22:52:48.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1983e224-2c2a-48bc-bc72-cb6e691b723b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82822025-08-12T22:52:48.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1983e224-2c2a-48bc-bc72-cb6e691b723b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82832025-08-12T22:52:48.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1983e224-2c2a-48bc-bc72-cb6e691b723b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82842025-08-12T22:52:48.836ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 584 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 091b8783-9198-444c-b324-5f02389d34e8 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
82852025-08-12T22:52:49.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b4f6d2cb-564f-4288-b97a-82705115ed92 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82862025-08-12T22:52:49.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b4f6d2cb-564f-4288-b97a-82705115ed92 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82872025-08-12T22:52:49.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b4f6d2cb-564f-4288-b97a-82705115ed92 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82882025-08-12T22:52:50.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fb7c2807-dee6-4ebd-87a4-25c789322f9f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82892025-08-12T22:52:50.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fb7c2807-dee6-4ebd-87a4-25c789322f9f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82902025-08-12T22:52:50.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fb7c2807-dee6-4ebd-87a4-25c789322f9f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
82912025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
82922025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
82932025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82942025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
82952025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82962025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 20 reason = Timeout
82972025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
82982025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 25.171\u{b5}s iteration = 20 status = {"disabled":true,"errors":[],"sps":[]}
82992025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
83002025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
83012025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83022025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83032025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83042025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
83052025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
83062025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83072025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83082025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
83092025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83102025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83112025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
83122025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
83132025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
83142025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83152025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
83162025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83172025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
83182025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83192025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
83202025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
83212025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83222025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83232025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
83242025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83252025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
83262025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83272025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
83282025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 115 reason = Timeout
83292025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
83302025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83312025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
83322025-08-12T22:52:51.048ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83332025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83342025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83352025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
83362025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83372025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83382025-08-12T22:52:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83392025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83402025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
83412025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83422025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83432025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83442025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83452025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83462025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
83472025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83482025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83492025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83502025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83512025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83522025-08-12T22:52:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83532025-08-12T22:52:51.050ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83542025-08-12T22:52:51.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.716186ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
83552025-08-12T22:52:51.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83562025-08-12T22:52:51.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.874028ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
83572025-08-12T22:52:51.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83582025-08-12T22:52:51.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83592025-08-12T22:52:51.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83602025-08-12T22:52:51.051ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1573, tv_nsec: 284930501 } })
83612025-08-12T22:52:51.051ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83622025-08-12T22:52:51.051ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1573, tv_nsec: 285179434 } })
83632025-08-12T22:52:51.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83642025-08-12T22:52:51.051ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
83652025-08-12T22:52:51.051ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.731887ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83662025-08-12T22:52:51.051ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
83672025-08-12T22:52:51.054ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83682025-08-12T22:52:51.055ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83692025-08-12T22:52:51.055ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 6.983088ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
83702025-08-12T22:52:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83712025-08-12T22:52:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83722025-08-12T22:52:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83732025-08-12T22:52:51.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83742025-08-12T22:52:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83752025-08-12T22:52:51.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83762025-08-12T22:52:51.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83772025-08-12T22:52:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83782025-08-12T22:52:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83792025-08-12T22:52:51.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83802025-08-12T22:52:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
83812025-08-12T22:52:51.056ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83822025-08-12T22:52:51.056ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.610914ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83832025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83842025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83852025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83862025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83872025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83882025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83892025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83902025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
83912025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
83922025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83932025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
83942025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83952025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83962025-08-12T22:52:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83972025-08-12T22:52:51.058ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 10.826095ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83982025-08-12T22:52:51.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83992025-08-12T22:52:51.059ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
84002025-08-12T22:52:51.059ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 11.281111ms iteration = 115 status = {"chicken_switches_updated":false}
84012025-08-12T22:52:51.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84022025-08-12T22:52:51.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84032025-08-12T22:52:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84042025-08-12T22:52:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84052025-08-12T22:52:51.063ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84062025-08-12T22:52:51.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84072025-08-12T22:52:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84082025-08-12T22:52:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84092025-08-12T22:52:51.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84102025-08-12T22:52:51.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84112025-08-12T22:52:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84122025-08-12T22:52:51.066ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1573, tv_nsec: 299736966 } })
84132025-08-12T22:52:51.066ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
84142025-08-12T22:52:51.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
84152025-08-12T22:52:51.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84162025-08-12T22:52:51.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84172025-08-12T22:52:51.072ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 24.49896ms iteration = 22 status = {"physical_disks_added":0}
84182025-08-12T22:52:51.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
84192025-08-12T22:52:51.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.294767ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
84202025-08-12T22:52:51.090ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84212025-08-12T22:52:51.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84222025-08-12T22:52:51.096ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84232025-08-12T22:52:51.096ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84242025-08-12T22:52:51.096ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84252025-08-12T22:52:51.096ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84262025-08-12T22:52:51.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84272025-08-12T22:52:51.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84282025-08-12T22:52:51.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84292025-08-12T22:52:51.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84302025-08-12T22:52:51.099ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84312025-08-12T22:52:51.099ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84322025-08-12T22:52:51.099ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84332025-08-12T22:52:51.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84342025-08-12T22:52:51.102ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84352025-08-12T22:52:51.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84362025-08-12T22:52:51.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.317292ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84372025-08-12T22:52:51.106ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84382025-08-12T22:52:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84392025-08-12T22:52:51.110ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84402025-08-12T22:52:51.110ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.994238ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84412025-08-12T22:52:51.111ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84422025-08-12T22:52:51.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84432025-08-12T22:52:51.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84442025-08-12T22:52:51.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
84452025-08-12T22:52:51.114ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84462025-08-12T22:52:51.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84472025-08-12T22:52:51.115ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
84482025-08-12T22:52:51.115ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 67.844825ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
84492025-08-12T22:52:51.116ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84502025-08-12T22:52:51.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84512025-08-12T22:52:51.118ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84522025-08-12T22:52:51.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
84532025-08-12T22:52:51.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84542025-08-12T22:52:51.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84552025-08-12T22:52:51.123ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 74.831784ms iteration = 20 status = 0
84562025-08-12T22:52:51.133ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84572025-08-12T22:52:51.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84582025-08-12T22:52:51.135ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 87.321937ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
84592025-08-12T22:52:51.140ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84602025-08-12T22:52:51.140ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84612025-08-12T22:52:51.140ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.78798ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84622025-08-12T22:52:51.159ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
84632025-08-12T22:52:51.159ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84642025-08-12T22:52:51.160ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c63dd1b2-0fa1-438a-86fc-bfe7ffa808d4", "content-length": "26", "date": "Tue, 12 Aug 2025 22:52:51 GMT"} })
84652025-08-12T22:52:51.160ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84662025-08-12T22:52:51.162ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84672025-08-12T22:52:51.163ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
84682025-08-12T22:52:51.163ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84692025-08-12T22:52:51.163ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2da49b27-2e4f-4276-a2ce-1a3e745d52b1", "content-length": "26", "date": "Tue, 12 Aug 2025 22:52:51 GMT"} })
84702025-08-12T22:52:51.163ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84712025-08-12T22:52:51.165ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84722025-08-12T22:52:51.172ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84732025-08-12T22:52:51.172ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84742025-08-12T22:52:51.173ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "446aae10-7608-4e5d-a459-3d354b21e495", "content-length": "372", "date": "Tue, 12 Aug 2025 22:52:51 GMT"} })
84752025-08-12T22:52:51.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84762025-08-12T22:52:51.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84772025-08-12T22:52:51.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84782025-08-12T22:52:51.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84792025-08-12T22:52:51.181ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
84802025-08-12T22:52:51.181ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84812025-08-12T22:52:51.181ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "256b3937-52fa-4fa2-bb77-a76232632f9f", "content-length": "26", "date": "Tue, 12 Aug 2025 22:52:51 GMT"} })
84822025-08-12T22:52:51.181ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84832025-08-12T22:52:51.183ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
84842025-08-12T22:52:51.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84852025-08-12T22:52:51.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84862025-08-12T22:52:51.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84872025-08-12T22:52:51.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84882025-08-12T22:52:51.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84892025-08-12T22:52:51.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84902025-08-12T22:52:51.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84912025-08-12T22:52:51.190ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84922025-08-12T22:52:51.190ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84932025-08-12T22:52:51.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84942025-08-12T22:52:51.234ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
84952025-08-12T22:52:51.234ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
84962025-08-12T22:52:51.235ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6a251147-1d83-49c8-bb55-624e7da276c0", "date": "Tue, 12 Aug 2025 22:52:51 GMT"} })
84972025-08-12T22:52:51.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84982025-08-12T22:52:51.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84992025-08-12T22:52:51.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85002025-08-12T22:52:51.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85012025-08-12T22:52:51.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85022025-08-12T22:52:51.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85032025-08-12T22:52:51.244ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85042025-08-12T22:52:51.244ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85052025-08-12T22:52:51.245ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "41f23986-146b-47cc-8a36-e860659d9303", "date": "Tue, 12 Aug 2025 22:52:51 GMT"} })
85062025-08-12T22:52:51.246ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 198.430816ms iteration = 20 status = {}
85072025-08-12T22:52:51.282ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 234.921475ms iteration = 20 status = {}
85082025-08-12T22:52:51.313ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85092025-08-12T22:52:51.313ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a78a7410-bc52-441e-9983-3f8835f6e388", "content-length": "691", "date": "Tue, 12 Aug 2025 22:52:51 GMT"} })
85102025-08-12T22:52:51.313ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
85112025-08-12T22:52:51.313ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
85122025-08-12T22:52:51.314ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
85132025-08-12T22:52:51.315ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 267.241201ms iteration = 20 status = {}
85142025-08-12T22:52:51.339ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85152025-08-12T22:52:51.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85162025-08-12T22:52:51.341ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 293.820021ms iteration = 20 status = null
85172025-08-12T22:52:51.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85182025-08-12T22:52:51.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85192025-08-12T22:52:51.416ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
85202025-08-12T22:52:51.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85212025-08-12T22:52:51.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85222025-08-12T22:52:51.431ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
85232025-08-12T22:52:51.431ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
85242025-08-12T22:52:51.435ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85252025-08-12T22:52:51.435ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85262025-08-12T22:52:51.435ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85272025-08-12T22:52:51.435ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85282025-08-12T22:52:51.435ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85292025-08-12T22:52:51.435ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85302025-08-12T22:52:51.435ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85312025-08-12T22:52:51.435ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85322025-08-12T22:52:51.436ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
85332025-08-12T22:52:51.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85342025-08-12T22:52:51.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85352025-08-12T22:52:51.440ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
85362025-08-12T22:52:51.440ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85372025-08-12T22:52:51.557ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6598fcf1-75e3-4af8-b61e-847097b18f0d", "date": "Tue, 12 Aug 2025 22:52:51 GMT"} })
85382025-08-12T22:52:51.557ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
85392025-08-12T22:52:51.557ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85402025-08-12T22:52:51.558ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cacc52b-2858-4b51-b4a2-1e138a112846", "content-length": "682", "date": "Tue, 12 Aug 2025 22:52:51 GMT"} })
85412025-08-12T22:52:51.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85422025-08-12T22:52:51.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85432025-08-12T22:52:51.561ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85442025-08-12T22:52:51.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85452025-08-12T22:52:51.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85462025-08-12T22:52:51.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85472025-08-12T22:52:51.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85482025-08-12T22:52:51.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85492025-08-12T22:52:51.573ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 525.042209ms iteration = 20 status = {}
85502025-08-12T22:52:51.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4d68d3fe-3e16-4fb9-8bde-d4fed951decc roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85512025-08-12T22:52:51.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4d68d3fe-3e16-4fb9-8bde-d4fed951decc resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85522025-08-12T22:52:51.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4d68d3fe-3e16-4fb9-8bde-d4fed951decc response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85532025-08-12T22:52:52.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7129317e-b2f1-4721-b0ed-ac43392f5c37 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85542025-08-12T22:52:52.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7129317e-b2f1-4721-b0ed-ac43392f5c37 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85552025-08-12T22:52:52.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7129317e-b2f1-4721-b0ed-ac43392f5c37 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85562025-08-12T22:52:53.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 47278a88-204e-4a48-884a-152ffa72c6da roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85572025-08-12T22:52:53.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 47278a88-204e-4a48-884a-152ffa72c6da resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85582025-08-12T22:52:53.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 47278a88-204e-4a48-884a-152ffa72c6da response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85592025-08-12T22:52:54.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0fcb95ed-376b-403c-813a-d216b32063f7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85602025-08-12T22:52:54.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0fcb95ed-376b-403c-813a-d216b32063f7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85612025-08-12T22:52:54.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0fcb95ed-376b-403c-813a-d216b32063f7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85622025-08-12T22:52:55.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 91ed6c7d-7422-47b8-94f3-5e2c3ccb2539 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85632025-08-12T22:52:55.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 91ed6c7d-7422-47b8-94f3-5e2c3ccb2539 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85642025-08-12T22:52:55.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 91ed6c7d-7422-47b8-94f3-5e2c3ccb2539 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85652025-08-12T22:52:56.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 116 reason = Timeout
85662025-08-12T22:52:56.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
85672025-08-12T22:52:56.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
85682025-08-12T22:52:56.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85692025-08-12T22:52:56.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
85702025-08-12T22:52:56.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
85712025-08-12T22:52:56.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
85722025-08-12T22:52:56.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
85732025-08-12T22:52:56.056ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.701455ms iteration = 116 status = {"chicken_switches_updated":false}
85742025-08-12T22:52:56.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = feac5572-d6be-40a6-98fc-1f7de09163d0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85752025-08-12T22:52:56.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = feac5572-d6be-40a6-98fc-1f7de09163d0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85762025-08-12T22:52:56.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = feac5572-d6be-40a6-98fc-1f7de09163d0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85772025-08-12T22:52:57.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9e322302-ac2d-4618-9e68-6bd9749be260 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85782025-08-12T22:52:57.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9e322302-ac2d-4618-9e68-6bd9749be260 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85792025-08-12T22:52:57.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9e322302-ac2d-4618-9e68-6bd9749be260 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85802025-08-12T22:52:58.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e43f1cb1-e8e6-48e5-a920-d5f76190ac89 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85812025-08-12T22:52:58.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e43f1cb1-e8e6-48e5-a920-d5f76190ac89 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85822025-08-12T22:52:58.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e43f1cb1-e8e6-48e5-a920-d5f76190ac89 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85832025-08-12T22:52:58.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57540 req_id = 76c2aa58-9e07-46bc-afce-4adf6f14f729 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
85842025-08-12T22:52:58.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57540 req_id = 76c2aa58-9e07-46bc-afce-4adf6f14f729 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
85852025-08-12T22:52:58.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57540 req_id = 76c2aa58-9e07-46bc-afce-4adf6f14f729 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
85862025-08-12T22:52:58.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57540 req_id = 2a3439b2-5579-45f3-8b52-c7069805d7ba roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
85872025-08-12T22:52:58.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57540 req_id = 2a3439b2-5579-45f3-8b52-c7069805d7ba resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
85882025-08-12T22:52:58.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57540 req_id = 2a3439b2-5579-45f3-8b52-c7069805d7ba response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
85892025-08-12T22:52:58.836ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 695 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 67acccea-ed7d-4396-b487-678a8e54865a response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
85902025-08-12T22:52:59.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f1fc4ff2-8d60-42d1-b7bd-dc6c416f6674 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85912025-08-12T22:52:59.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f1fc4ff2-8d60-42d1-b7bd-dc6c416f6674 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85922025-08-12T22:52:59.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f1fc4ff2-8d60-42d1-b7bd-dc6c416f6674 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85932025-08-12T22:53:00.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 359614ef-a358-4cef-a0d8-11d648549f0f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85942025-08-12T22:53:00.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 359614ef-a358-4cef-a0d8-11d648549f0f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85952025-08-12T22:53:00.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 359614ef-a358-4cef-a0d8-11d648549f0f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
85962025-08-12T22:53:01.048ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
85972025-08-12T22:53:01.048ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
85982025-08-12T22:53:01.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85992025-08-12T22:53:01.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86002025-08-12T22:53:01.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 117 reason = Timeout
86012025-08-12T22:53:01.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
86022025-08-12T22:53:01.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86032025-08-12T22:53:01.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86042025-08-12T22:53:01.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
86052025-08-12T22:53:01.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86062025-08-12T22:53:01.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86072025-08-12T22:53:01.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86082025-08-12T22:53:01.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86092025-08-12T22:53:01.052ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.112521ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86102025-08-12T22:53:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
86112025-08-12T22:53:01.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
86122025-08-12T22:53:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86132025-08-12T22:53:01.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86142025-08-12T22:53:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
86152025-08-12T22:53:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86162025-08-12T22:53:01.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86172025-08-12T22:53:01.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
86182025-08-12T22:53:01.056ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.671635ms iteration = 117 status = {"chicken_switches_updated":false}
86192025-08-12T22:53:01.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86202025-08-12T22:53:01.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86212025-08-12T22:53:01.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
86222025-08-12T22:53:01.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86232025-08-12T22:53:01.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86242025-08-12T22:53:01.086ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
86252025-08-12T22:53:01.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.942292ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
86262025-08-12T22:53:01.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 410072e1-9e07-4dda-9a7a-cbad82601beb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86272025-08-12T22:53:01.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 410072e1-9e07-4dda-9a7a-cbad82601beb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86282025-08-12T22:53:01.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 410072e1-9e07-4dda-9a7a-cbad82601beb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86292025-08-12T22:53:02.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 68c663e3-669b-4463-a000-9214f47ced06 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86302025-08-12T22:53:02.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 68c663e3-669b-4463-a000-9214f47ced06 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86312025-08-12T22:53:02.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 68c663e3-669b-4463-a000-9214f47ced06 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86322025-08-12T22:53:03.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 12d80333-e636-4fad-ba4a-490bc5f02436 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86332025-08-12T22:53:03.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 12d80333-e636-4fad-ba4a-490bc5f02436 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86342025-08-12T22:53:03.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 12d80333-e636-4fad-ba4a-490bc5f02436 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86352025-08-12T22:53:04.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e449b664-1b8b-4832-aaec-075ea091fcf2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86362025-08-12T22:53:04.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e449b664-1b8b-4832-aaec-075ea091fcf2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86372025-08-12T22:53:04.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e449b664-1b8b-4832-aaec-075ea091fcf2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86382025-08-12T22:53:05.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2b22e105-0ba1-4e9e-8416-33fd86ef313d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86392025-08-12T22:53:05.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2b22e105-0ba1-4e9e-8416-33fd86ef313d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86402025-08-12T22:53:05.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2b22e105-0ba1-4e9e-8416-33fd86ef313d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86412025-08-12T22:53:06.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 118 reason = Timeout
86422025-08-12T22:53:06.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
86432025-08-12T22:53:06.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
86442025-08-12T22:53:06.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86452025-08-12T22:53:06.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
86462025-08-12T22:53:06.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
86472025-08-12T22:53:06.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
86482025-08-12T22:53:06.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
86492025-08-12T22:53:06.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.620285ms iteration = 118 status = {"chicken_switches_updated":false}
86502025-08-12T22:53:06.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 92911bfd-8339-4750-a3a0-0cecd0c1f1a9 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86512025-08-12T22:53:06.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 92911bfd-8339-4750-a3a0-0cecd0c1f1a9 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86522025-08-12T22:53:06.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 92911bfd-8339-4750-a3a0-0cecd0c1f1a9 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86532025-08-12T22:53:07.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cdc71261-5784-4189-bf61-096608f641f0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86542025-08-12T22:53:07.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cdc71261-5784-4189-bf61-096608f641f0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86552025-08-12T22:53:07.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cdc71261-5784-4189-bf61-096608f641f0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86562025-08-12T22:53:08.837ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 626 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 1ef65608-d828-48e0-8e76-fd377751773e response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
86572025-08-12T22:53:08.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 420f35b0-6d37-4649-a86a-10a45898a545 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86582025-08-12T22:53:08.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 420f35b0-6d37-4649-a86a-10a45898a545 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86592025-08-12T22:53:08.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5762 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 420f35b0-6d37-4649-a86a-10a45898a545 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86602025-08-12T22:53:09.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = af7e6e41-efbd-45b0-921f-4767c76ad5b5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86612025-08-12T22:53:09.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = af7e6e41-efbd-45b0-921f-4767c76ad5b5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86622025-08-12T22:53:09.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = af7e6e41-efbd-45b0-921f-4767c76ad5b5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86632025-08-12T22:53:10.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 74ed0dc8-94a3-4b7d-b241-d4af9280e9ce roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86642025-08-12T22:53:10.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 74ed0dc8-94a3-4b7d-b241-d4af9280e9ce resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86652025-08-12T22:53:10.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 74ed0dc8-94a3-4b7d-b241-d4af9280e9ce response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86662025-08-12T22:53:11.049ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
86672025-08-12T22:53:11.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86682025-08-12T22:53:11.049ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
86692025-08-12T22:53:11.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86702025-08-12T22:53:11.049ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 119 reason = Timeout
86712025-08-12T22:53:11.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
86722025-08-12T22:53:11.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86732025-08-12T22:53:11.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86742025-08-12T22:53:11.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
86752025-08-12T22:53:11.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86762025-08-12T22:53:11.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86772025-08-12T22:53:11.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86782025-08-12T22:53:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86792025-08-12T22:53:11.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.318322ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86802025-08-12T22:53:11.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
86812025-08-12T22:53:11.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
86822025-08-12T22:53:11.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86832025-08-12T22:53:11.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86842025-08-12T22:53:11.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
86852025-08-12T22:53:11.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86862025-08-12T22:53:11.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86872025-08-12T22:53:11.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
86882025-08-12T22:53:11.056ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.354872ms iteration = 119 status = {"chicken_switches_updated":false}
86892025-08-12T22:53:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86902025-08-12T22:53:11.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86912025-08-12T22:53:11.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
86922025-08-12T22:53:11.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86932025-08-12T22:53:11.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86942025-08-12T22:53:11.074ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
86952025-08-12T22:53:11.074ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.261818ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
86962025-08-12T22:53:11.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7eee0ff9-de43-4ce4-9fb0-a93ed83cb733 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86972025-08-12T22:53:11.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7eee0ff9-de43-4ce4-9fb0-a93ed83cb733 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86982025-08-12T22:53:11.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7eee0ff9-de43-4ce4-9fb0-a93ed83cb733 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
86992025-08-12T22:53:13.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c3ab872b-3714-4cae-91b9-59b8a10d63dd roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87002025-08-12T22:53:13.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c3ab872b-3714-4cae-91b9-59b8a10d63dd resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87012025-08-12T22:53:13.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c3ab872b-3714-4cae-91b9-59b8a10d63dd response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87022025-08-12T22:53:14.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a04dff0a-3149-4690-8537-a9d07dc4a7bb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87032025-08-12T22:53:14.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a04dff0a-3149-4690-8537-a9d07dc4a7bb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87042025-08-12T22:53:14.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a04dff0a-3149-4690-8537-a9d07dc4a7bb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87052025-08-12T22:53:15.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fb01dbf4-485e-4e47-a520-1dc64281bca0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87062025-08-12T22:53:15.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fb01dbf4-485e-4e47-a520-1dc64281bca0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87072025-08-12T22:53:15.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fb01dbf4-485e-4e47-a520-1dc64281bca0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87082025-08-12T22:53:16.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 120 reason = Timeout
87092025-08-12T22:53:16.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
87102025-08-12T22:53:16.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
87112025-08-12T22:53:16.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9c6d4438-6ce1-4587-85a1-26829158109a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87122025-08-12T22:53:16.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87132025-08-12T22:53:16.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9c6d4438-6ce1-4587-85a1-26829158109a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87142025-08-12T22:53:16.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9c6d4438-6ce1-4587-85a1-26829158109a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87152025-08-12T22:53:16.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
87162025-08-12T22:53:16.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
87172025-08-12T22:53:16.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
87182025-08-12T22:53:16.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
87192025-08-12T22:53:16.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.978968ms iteration = 120 status = {"chicken_switches_updated":false}
87202025-08-12T22:53:17.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2b6102b3-22d1-4377-88ee-55177f31698b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87212025-08-12T22:53:17.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2b6102b3-22d1-4377-88ee-55177f31698b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87222025-08-12T22:53:17.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2b6102b3-22d1-4377-88ee-55177f31698b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87232025-08-12T22:53:18.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bf625547-78ca-4bf8-91e1-fc652f530627 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87242025-08-12T22:53:18.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bf625547-78ca-4bf8-91e1-fc652f530627 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87252025-08-12T22:53:18.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bf625547-78ca-4bf8-91e1-fc652f530627 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87262025-08-12T22:53:18.837ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 866 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = ed6f3514-c7e4-4293-bc44-3d3251b61b6e response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
87272025-08-12T22:53:19.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 03752a78-13b1-4c84-9d83-eaf7783bf614 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87282025-08-12T22:53:19.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 03752a78-13b1-4c84-9d83-eaf7783bf614 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87292025-08-12T22:53:19.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 03752a78-13b1-4c84-9d83-eaf7783bf614 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87302025-08-12T22:53:20.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2b3f3add-d5d6-4822-9223-64c64fdde403 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87312025-08-12T22:53:20.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2b3f3add-d5d6-4822-9223-64c64fdde403 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87322025-08-12T22:53:20.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2b3f3add-d5d6-4822-9223-64c64fdde403 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
87332025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
87342025-08-12T22:53:21.048ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0
87352025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.09\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0"}
87362025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
87372025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
87382025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87392025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
87402025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87412025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
87422025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
87432025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87442025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
87452025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
87462025-08-12T22:53:21.048ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-12 22:43:21.048463027 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
87472025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
87482025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
87492025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
87502025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87512025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
87522025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
87532025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
87542025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
87552025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87562025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
87572025-08-12T22:53:21.048ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
87582025-08-12T22:53:21.048ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
87592025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
87602025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
87612025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 11 reason = Timeout
87622025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
87632025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
87642025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87652025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
87662025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
87672025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 121 reason = Timeout
87682025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87692025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
87702025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
87712025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87722025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87732025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
87742025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
87752025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
87762025-08-12T22:53:21.048ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87772025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87782025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 11 reason = Timeout
87792025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
87802025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
87812025-08-12T22:53:21.048ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
87822025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87832025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
87842025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87852025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87862025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
87872025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87882025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
87892025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87902025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
87912025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87922025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
87932025-08-12T22:53:21.048ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
87942025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87952025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 14 reason = Timeout
87962025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
87972025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 9.46\u{b5}s iteration = 14 status = "Disabled"
87982025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
87992025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
88002025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
88012025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
88022025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
88032025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88042025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88052025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
88062025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88072025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
88082025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88092025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
88102025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88112025-08-12T22:53:21.048ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
88122025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88132025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 21 reason = Timeout
88142025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
88152025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88162025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 13.631\u{b5}s iteration = 21 status = {"disabled":true,"errors":[],"sps":[]}
88172025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
88182025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
88192025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88202025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
88212025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
88222025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
88232025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
88242025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88252025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88262025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88272025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
88282025-08-12T22:53:21.049ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
88292025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88302025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
88312025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88322025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88332025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88342025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88352025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
88362025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88372025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
88382025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88392025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
88402025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88412025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88422025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88432025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
88442025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88452025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88462025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88472025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88482025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
88492025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88502025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88512025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
88522025-08-12T22:53:21.049ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3e3264d-303d-4ce7-a0ce-0090b10b154f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 282722318 } })
88532025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88542025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
88552025-08-12T22:53:21.049ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("043b8097-0e38-4228-bada-dac70e518148.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26cd5275-57f5-4466-a94f-f96956f55588.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 282766418 } })
88562025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88572025-08-12T22:53:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
88582025-08-12T22:53:21.050ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
88592025-08-12T22:53:21.050ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.725877ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
88602025-08-12T22:53:21.050ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
88612025-08-12T22:53:21.050ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.801258ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
88622025-08-12T22:53:21.050ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88632025-08-12T22:53:21.051ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88642025-08-12T22:53:21.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88652025-08-12T22:53:21.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88662025-08-12T22:53:21.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88672025-08-12T22:53:21.051ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 284988030 } })
88682025-08-12T22:53:21.051ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-12 22:43:21.048463027 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
88692025-08-12T22:53:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.455044ms iteration = 11 status = {"expiration":"2025-08-12T22:43:21.048463027Z","pruned":[]}
88702025-08-12T22:53:21.051ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88712025-08-12T22:53:21.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88722025-08-12T22:53:21.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88732025-08-12T22:53:21.052ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88742025-08-12T22:53:21.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88752025-08-12T22:53:21.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88762025-08-12T22:53:21.052ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
88772025-08-12T22:53:21.052ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 285481915 } })
88782025-08-12T22:53:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88792025-08-12T22:53:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88802025-08-12T22:53:21.052ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
88812025-08-12T22:53:21.052ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88822025-08-12T22:53:21.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88832025-08-12T22:53:21.052ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88842025-08-12T22:53:21.053ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.884608ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88852025-08-12T22:53:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88862025-08-12T22:53:21.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88872025-08-12T22:53:21.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88882025-08-12T22:53:21.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.235122ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
88892025-08-12T22:53:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88902025-08-12T22:53:21.054ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.039059ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
88912025-08-12T22:53:21.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88922025-08-12T22:53:21.054ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
88932025-08-12T22:53:21.054ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 6.378233ms iteration = 11 status = {"by_rx":{},"error":null}
88942025-08-12T22:53:21.055ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88952025-08-12T22:53:21.055ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88962025-08-12T22:53:21.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88972025-08-12T22:53:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88982025-08-12T22:53:21.055ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88992025-08-12T22:53:21.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89002025-08-12T22:53:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89012025-08-12T22:53:21.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89022025-08-12T22:53:21.056ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
89032025-08-12T22:53:21.056ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 8.262301ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
89042025-08-12T22:53:21.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89052025-08-12T22:53:21.056ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89062025-08-12T22:53:21.057ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89072025-08-12T22:53:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89082025-08-12T22:53:21.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89092025-08-12T22:53:21.057ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
89102025-08-12T22:53:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
89112025-08-12T22:53:21.058ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89122025-08-12T22:53:21.058ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89132025-08-12T22:53:21.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89142025-08-12T22:53:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89152025-08-12T22:53:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
89162025-08-12T22:53:21.059ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
89172025-08-12T22:53:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
89182025-08-12T22:53:21.059ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
89192025-08-12T22:53:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
89202025-08-12T22:53:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
89212025-08-12T22:53:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89222025-08-12T22:53:21.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89232025-08-12T22:53:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89242025-08-12T22:53:21.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89252025-08-12T22:53:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89262025-08-12T22:53:21.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
89272025-08-12T22:53:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89282025-08-12T22:53:21.060ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
89292025-08-12T22:53:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
89302025-08-12T22:53:21.060ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
89312025-08-12T22:53:21.060ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 11.560973ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89322025-08-12T22:53:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
89332025-08-12T22:53:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
89342025-08-12T22:53:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89352025-08-12T22:53:21.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89362025-08-12T22:53:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89372025-08-12T22:53:21.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89382025-08-12T22:53:21.062ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89392025-08-12T22:53:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89402025-08-12T22:53:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89412025-08-12T22:53:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89422025-08-12T22:53:21.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89432025-08-12T22:53:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
89442025-08-12T22:53:21.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
89452025-08-12T22:53:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89462025-08-12T22:53:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
89472025-08-12T22:53:21.063ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
89482025-08-12T22:53:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
89492025-08-12T22:53:21.063ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89502025-08-12T22:53:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89512025-08-12T22:53:21.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89522025-08-12T22:53:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
89532025-08-12T22:53:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89542025-08-12T22:53:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89552025-08-12T22:53:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89562025-08-12T22:53:21.064ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89572025-08-12T22:53:21.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89582025-08-12T22:53:21.064ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 16.181839ms iteration = 11 status = {"dispatched":[],"errors":[],"glob_version":"180.0.0","globs_reprocessed":{},"no_receivers":[]}
89592025-08-12T22:53:21.065ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89602025-08-12T22:53:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89612025-08-12T22:53:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89622025-08-12T22:53:21.065ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89632025-08-12T22:53:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89642025-08-12T22:53:21.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89652025-08-12T22:53:21.066ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
89662025-08-12T22:53:21.066ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
89672025-08-12T22:53:21.066ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
89682025-08-12T22:53:21.066ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 18.168519ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
89692025-08-12T22:53:21.066ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
89702025-08-12T22:53:21.067ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 300054858 } })
89712025-08-12T22:53:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
89722025-08-12T22:53:21.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89732025-08-12T22:53:21.067ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
89742025-08-12T22:53:21.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89752025-08-12T22:53:21.068ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
89762025-08-12T22:53:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89772025-08-12T22:53:21.068ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 20.084188ms iteration = 121 status = {"chicken_switches_updated":false}
89782025-08-12T22:53:21.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
89792025-08-12T22:53:21.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89802025-08-12T22:53:21.069ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89812025-08-12T22:53:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
89822025-08-12T22:53:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89832025-08-12T22:53:21.069ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89842025-08-12T22:53:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89852025-08-12T22:53:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89862025-08-12T22:53:21.070ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89872025-08-12T22:53:21.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89882025-08-12T22:53:21.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89892025-08-12T22:53:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89902025-08-12T22:53:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89912025-08-12T22:53:21.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89922025-08-12T22:53:21.072ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(bf82738b-24fb-493c-9431-7bde16054f66, 0), (af8be6e5-210c-4deb-9ffb-3004f27daca8, 0), (0e0393a2-6072-45ae-a671-a6b7e14ef5c0, 0), (a1196f4c-0a86-450c-97a6-e869884ace3e, 0)] collection_id = bf82738b-24fb-493c-9431-7bde16054f66
89932025-08-12T22:53:21.072ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
89942025-08-12T22:53:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89952025-08-12T22:53:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
89962025-08-12T22:53:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
89972025-08-12T22:53:21.073ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89982025-08-12T22:53:21.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89992025-08-12T22:53:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90002025-08-12T22:53:21.075ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90012025-08-12T22:53:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
90022025-08-12T22:53:21.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90032025-08-12T22:53:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90042025-08-12T22:53:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
90052025-08-12T22:53:21.081ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90062025-08-12T22:53:21.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90072025-08-12T22:53:21.120ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
90082025-08-12T22:53:21.120ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
90092025-08-12T22:53:21.120ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
90102025-08-12T22:53:21.120ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90112025-08-12T22:53:21.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90122025-08-12T22:53:21.124ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
90132025-08-12T22:53:21.124ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 76.135757ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
90142025-08-12T22:53:21.125ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90152025-08-12T22:53:21.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90162025-08-12T22:53:21.125ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90172025-08-12T22:53:21.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90182025-08-12T22:53:21.127ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90192025-08-12T22:53:21.127ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90202025-08-12T22:53:21.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90212025-08-12T22:53:21.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90222025-08-12T22:53:21.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90232025-08-12T22:53:21.128ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90242025-08-12T22:53:21.128ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
90252025-08-12T22:53:21.128ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.057055ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
90262025-08-12T22:53:21.129ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90272025-08-12T22:53:21.129ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 80.659781ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
90282025-08-12T22:53:21.129ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90292025-08-12T22:53:21.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90302025-08-12T22:53:21.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90312025-08-12T22:53:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90322025-08-12T22:53:21.131ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90332025-08-12T22:53:21.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2845b0c8-a083-4b8d-b449-9c2ba13ba60b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
90342025-08-12T22:53:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90352025-08-12T22:53:21.131ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 82.806852ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
90362025-08-12T22:53:21.131ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.702841ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90372025-08-12T22:53:21.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2845b0c8-a083-4b8d-b449-9c2ba13ba60b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
90382025-08-12T22:53:21.132ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
90392025-08-12T22:53:21.132ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
90402025-08-12T22:53:21.132ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
90412025-08-12T22:53:21.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90422025-08-12T22:53:21.132ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
90432025-08-12T22:53:21.132ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90442025-08-12T22:53:21.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90452025-08-12T22:53:21.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90462025-08-12T22:53:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90472025-08-12T22:53:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90482025-08-12T22:53:21.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90492025-08-12T22:53:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
90502025-08-12T22:53:21.133ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90512025-08-12T22:53:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90522025-08-12T22:53:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90532025-08-12T22:53:21.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2845b0c8-a083-4b8d-b449-9c2ba13ba60b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
90542025-08-12T22:53:21.134ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
90552025-08-12T22:53:21.134ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
90562025-08-12T22:53:21.134ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 85.70322ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
90572025-08-12T22:53:21.134ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90582025-08-12T22:53:21.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90592025-08-12T22:53:21.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90602025-08-12T22:53:21.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.526318ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90612025-08-12T22:53:21.136ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90622025-08-12T22:53:21.136ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90632025-08-12T22:53:21.136ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 88.059484ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90642025-08-12T22:53:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
90652025-08-12T22:53:21.138ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90662025-08-12T22:53:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90672025-08-12T22:53:21.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90682025-08-12T22:53:21.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90692025-08-12T22:53:21.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90702025-08-12T22:53:21.141ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
90712025-08-12T22:53:21.141ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 0 version = 2
90722025-08-12T22:53:21.141ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90732025-08-12T22:53:21.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90742025-08-12T22:53:21.142ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90752025-08-12T22:53:21.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90762025-08-12T22:53:21.143ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 94.692258ms iteration = 23 status = {"physical_disks_added":0}
90772025-08-12T22:53:21.143ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90782025-08-12T22:53:21.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90792025-08-12T22:53:21.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90802025-08-12T22:53:21.144ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90812025-08-12T22:53:21.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90822025-08-12T22:53:21.146ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90832025-08-12T22:53:21.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90842025-08-12T22:53:21.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90852025-08-12T22:53:21.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90862025-08-12T22:53:21.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90872025-08-12T22:53:21.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90882025-08-12T22:53:21.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90892025-08-12T22:53:21.148ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
90902025-08-12T22:53:21.148ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.517846ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
90912025-08-12T22:53:21.148ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90922025-08-12T22:53:21.149ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 4 version = 2
90932025-08-12T22:53:21.149ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
90942025-08-12T22:53:21.149ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-12 22:43:50.527483 UTC dns_group = external generation = 2
90952025-08-12T22:53:21.149ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 100.959311ms iteration = 11 status = {"generation":2}
90962025-08-12T22:53:21.149ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90972025-08-12T22:53:21.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90982025-08-12T22:53:21.151ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90992025-08-12T22:53:21.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91002025-08-12T22:53:21.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
91012025-08-12T22:53:21.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91022025-08-12T22:53:21.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91032025-08-12T22:53:21.153ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91042025-08-12T22:53:21.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91052025-08-12T22:53:21.154ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
91062025-08-12T22:53:21.154ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.795198ms iteration = 21 status = 0
91072025-08-12T22:53:21.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91082025-08-12T22:53:21.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
91092025-08-12T22:53:21.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91102025-08-12T22:53:21.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
91112025-08-12T22:53:21.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
91122025-08-12T22:53:21.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
91132025-08-12T22:53:21.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
91142025-08-12T22:53:21.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91152025-08-12T22:53:21.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91162025-08-12T22:53:21.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91172025-08-12T22:53:21.163ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91182025-08-12T22:53:21.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91192025-08-12T22:53:21.165ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
91202025-08-12T22:53:21.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
91212025-08-12T22:53:21.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
91222025-08-12T22:53:21.166ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91232025-08-12T22:53:21.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91242025-08-12T22:53:21.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
91252025-08-12T22:53:21.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
91262025-08-12T22:53:21.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91272025-08-12T22:53:21.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91282025-08-12T22:53:21.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91292025-08-12T22:53:21.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91302025-08-12T22:53:21.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
91312025-08-12T22:53:21.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
91322025-08-12T22:53:21.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91332025-08-12T22:53:21.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
91342025-08-12T22:53:21.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91352025-08-12T22:53:21.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91362025-08-12T22:53:21.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91372025-08-12T22:53:21.175ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91382025-08-12T22:53:21.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91392025-08-12T22:53:21.176ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
91402025-08-12T22:53:21.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
91412025-08-12T22:53:21.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
91422025-08-12T22:53:21.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 128.40418ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
91432025-08-12T22:53:21.177ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
91442025-08-12T22:53:21.177ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91452025-08-12T22:53:21.177ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 128.576681ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
91462025-08-12T22:53:21.179ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
91472025-08-12T22:53:21.179ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 130.199607ms iteration = 5 status = {"blueprint_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","inventory_collection_id":"a1196f4c-0a86-450c-97a6-e869884ace3e","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
91482025-08-12T22:53:21.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
91492025-08-12T22:53:21.182ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91502025-08-12T22:53:21.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91512025-08-12T22:53:21.183ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-12T22:43:09.981233Z, time_modified: 2025-08-12T22:43:09.981233Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }) }
91522025-08-12T22:53:21.183ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 135.485699ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]}},"default_endpoint":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
91532025-08-12T22:53:21.184ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91542025-08-12T22:53:21.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91552025-08-12T22:53:21.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91562025-08-12T22:53:21.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91572025-08-12T22:53:21.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91582025-08-12T22:53:21.188ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
91592025-08-12T22:53:21.188ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
91602025-08-12T22:53:21.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91612025-08-12T22:53:21.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91622025-08-12T22:53:21.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91632025-08-12T22:53:21.193ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
91642025-08-12T22:53:21.193ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91652025-08-12T22:53:21.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91662025-08-12T22:53:21.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91672025-08-12T22:53:21.194ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91682025-08-12T22:53:21.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91692025-08-12T22:53:21.195ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = bf82738b-24fb-493c-9431-7bde16054f66 file = nexus/db-queries/src/db/datastore/inventory.rs:2266 nboot_partitions = 0 ncabooses = 12 nclickhouse_keeper_membership = 0 ncockroach_status = 5 ncollections = 1 nconfig_reconcilers = 0 ndatasets = 0 nerrors = 0 nhost_phase1_active_slots = 1 nhost_phase1_flash_hashes = 2 ninternal_dns = 0 nlast_reconciliation_dataset_results = 0 nlast_reconciliation_disk_results = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 0 nmupdate_override_non_boot = 0 nntp_timesync = 0 nnvme_disk_firmware = 0 nomicron_sled_config_datasets = 0 nomicron_sled_config_disks = 0 nomicron_sled_config_zone_nics = 0 nomicron_sled_config_zones = 0 nomicron_sled_configs = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agents = 0 nsps = 2 nzone_manifest_non_boot = 0 nzone_manifest_zones = 0 nzpools = 0
91702025-08-12T22:53:21.195ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
91712025-08-12T22:53:21.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
91722025-08-12T22:53:21.196ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
91732025-08-12T22:53:21.196ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
91742025-08-12T22:53:21.196ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-12 22:43:49.909589 UTC dns_group = internal generation = 1
91752025-08-12T22:53:21.196ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 148.344185ms iteration = 11 status = {"generation":1}
91762025-08-12T22:53:21.197ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91772025-08-12T22:53:21.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91782025-08-12T22:53:21.199ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91792025-08-12T22:53:21.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91802025-08-12T22:53:21.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91812025-08-12T22:53:21.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91822025-08-12T22:53:21.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91832025-08-12T22:53:21.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91842025-08-12T22:53:21.207ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(af8be6e5-210c-4deb-9ffb-3004f27daca8, 0), (0e0393a2-6072-45ae-a671-a6b7e14ef5c0, 0), (a1196f4c-0a86-450c-97a6-e869884ace3e, 0)]
91852025-08-12T22:53:21.208ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 441606196 } })
91862025-08-12T22:53:21.208ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91872025-08-12T22:53:21.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91882025-08-12T22:53:21.210ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91892025-08-12T22:53:21.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91902025-08-12T22:53:21.215ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91912025-08-12T22:53:21.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91922025-08-12T22:53:21.219ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91932025-08-12T22:53:21.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
91942025-08-12T22:53:21.223ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91952025-08-12T22:53:21.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91962025-08-12T22:53:21.225ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91972025-08-12T22:53:21.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91982025-08-12T22:53:21.227ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91992025-08-12T22:53:21.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92002025-08-12T22:53:21.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92012025-08-12T22:53:21.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
92022025-08-12T22:53:21.234ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92032025-08-12T22:53:21.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92042025-08-12T22:53:21.241ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: c4b020d9-d7fd-4254-9df0-03a251a659ea, kind: Service { id: a3e3264d-303d-4ce7-a0ce-0090b10b154f }, name: Name("external-dns-a3e3264d-303d-4ce7-a0ce-0090b10b154f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dd861cef-e068-45c3-a33b-98735de0368c, kind: Service { id: d7d2275f-b0bb-4a69-bcc5-687d9e81abaf }, name: Name("external-dns-d7d2275f-b0bb-4a69-bcc5-687d9e81abaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 228])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 4fe06a86-0026-42b1-a394-38f25f72f387, kind: Service { id: 8c95eed0-ca33-44fa-9752-6c25556f7542 }, name: Name("nexus-8c95eed0-ca33-44fa-9752-6c25556f7542"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 72a54743-6163-4f5e-82c8-d7c201ff8d1c, kind: Service { id: 01906d6c-0b9c-44b5-804a-5f066c00adfe }, name: Name("nexus-01906d6c-0b9c-44b5-804a-5f066c00adfe"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d4b52e5a-04f2-45f1-94e6-23afee047fbf, kind: Service { id: 8ce01a52-aeb2-40b4-aa3d-1f24db666e92 }, name: Name("nexus-8ce01a52-aeb2-40b4-aa3d-1f24db666e92"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
92052025-08-12T22:53:21.241ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92062025-08-12T22:53:21.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92072025-08-12T22:53:21.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92082025-08-12T22:53:21.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92092025-08-12T22:53:21.243ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92102025-08-12T22:53:21.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92112025-08-12T22:53:21.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92122025-08-12T22:53:21.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92132025-08-12T22:53:21.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
92142025-08-12T22:53:21.246ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92152025-08-12T22:53:21.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92162025-08-12T22:53:21.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92172025-08-12T22:53:21.248ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92182025-08-12T22:53:21.249ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
92192025-08-12T22:53:21.249ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c4b020d9-d7fd-4254-9df0-03a251a659ea, kind: Service { id: a3e3264d-303d-4ce7-a0ce-0090b10b154f }, name: Name("external-dns-a3e3264d-303d-4ce7-a0ce-0090b10b154f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dd861cef-e068-45c3-a33b-98735de0368c, kind: Service { id: d7d2275f-b0bb-4a69-bcc5-687d9e81abaf }, name: Name("external-dns-d7d2275f-b0bb-4a69-bcc5-687d9e81abaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 228])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4fe06a86-0026-42b1-a394-38f25f72f387, kind: Service { id: 8c95eed0-ca33-44fa-9752-6c25556f7542 }, name: Name("nexus-8c95eed0-ca33-44fa-9752-6c25556f7542"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 72a54743-6163-4f5e-82c8-d7c201ff8d1c, kind: Service { id: 01906d6c-0b9c-44b5-804a-5f066c00adfe }, name: Name("nexus-01906d6c-0b9c-44b5-804a-5f066c00adfe"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d4b52e5a-04f2-45f1-94e6-23afee047fbf, kind: Service { id: 8ce01a52-aeb2-40b4-aa3d-1f24db666e92 }, name: Name("nexus-8ce01a52-aeb2-40b4-aa3d-1f24db666e92"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c4b020d9-d7fd-4254-9df0-03a251a659ea, kind: Service { id: a3e3264d-303d-4ce7-a0ce-0090b10b154f }, name: Name("external-dns-a3e3264d-303d-4ce7-a0ce-0090b10b154f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 85])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dd861cef-e068-45c3-a33b-98735de0368c, kind: Service { id: d7d2275f-b0bb-4a69-bcc5-687d9e81abaf }, name: Name("external-dns-d7d2275f-b0bb-4a69-bcc5-687d9e81abaf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 228])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 3, code: Some(IcmpParamRange { first: 3, last: 4 }) })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 5, code: None })), Icmp(Some(VpcFirewallIcmpFilter { icmp_type: 11, code: None }))]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4fe06a86-0026-42b1-a394-38f25f72f387, kind: Service { id: 8c95eed0-ca33-44fa-9752-6c25556f7542 }, name: Name("nexus-8c95eed0-ca33-44fa-9752-6c25556f7542"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 72a54743-6163-4f5e-82c8-d7c201ff8d1c, kind: Service { id: 01906d6c-0b9c-44b5-804a-5f066c00adfe }, name: Name("nexus-01906d6c-0b9c-44b5-804a-5f066c00adfe"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 197, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d4b52e5a-04f2-45f1-94e6-23afee047fbf, kind: Service { id: 8ce01a52-aeb2-40b4-aa3d-1f24db666e92 }, name: Name("nexus-8ce01a52-aeb2-40b4-aa3d-1f24db666e92"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }]
92202025-08-12T22:53:21.249ZDEBGnexus (service-firewall-rule-progator): resolved 3 rules for sleds background_task = service_firewall_rule_propagation
92212025-08-12T22:53:21.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92222025-08-12T22:53:21.250ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92232025-08-12T22:53:21.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92242025-08-12T22:53:21.263ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
92252025-08-12T22:53:21.300ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
92262025-08-12T22:53:21.321ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: d04697ae-b4b1-419d-b9da-432e45c93990, time_created: 2025-08-12T22:43:47.338146Z, time_modified: 2025-08-12T22:43:47.338146Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348), cpu_family: AmdMilan }]
92272025-08-12T22:53:21.321ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
92282025-08-12T22:53:21.355ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
92292025-08-12T22:53:21.355ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92302025-08-12T22:53:21.356ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebe89efb-dfad-4d70-91d1-0a49ac793422", "content-length": "372", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
92312025-08-12T22:53:21.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92322025-08-12T22:53:21.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92332025-08-12T22:53:21.373ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
92342025-08-12T22:53:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
92352025-08-12T22:53:21.378ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
92362025-08-12T22:53:21.378ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
92372025-08-12T22:53:21.379ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6c62f77e-bb96-4b40-a2de-6f679f73e562", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
92382025-08-12T22:53:21.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92392025-08-12T22:53:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92402025-08-12T22:53:21.388ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92412025-08-12T22:53:21.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92422025-08-12T22:53:21.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92432025-08-12T22:53:21.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92442025-08-12T22:53:21.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92452025-08-12T22:53:21.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
92462025-08-12T22:53:21.405ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
92472025-08-12T22:53:21.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
92482025-08-12T22:53:21.409ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
92492025-08-12T22:53:21.409ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92502025-08-12T22:53:21.410ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6030986e-837b-4798-a4c4-ea5ff9b91e2a", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
92512025-08-12T22:53:21.420ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 371.958898ms iteration = 21 status = {}
92522025-08-12T22:53:21.422ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
92532025-08-12T22:53:21.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
92542025-08-12T22:53:21.424ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92552025-08-12T22:53:21.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
92562025-08-12T22:53:21.427ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
92572025-08-12T22:53:21.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
92582025-08-12T22:53:21.431ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
92592025-08-12T22:53:21.431ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "74928a17-a6b4-41ff-a7a4-00e3269fcc21", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
92602025-08-12T22:53:21.431ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
92612025-08-12T22:53:21.432ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4b487e7-7cf9-48f5-8d6c-4793c95c8ad2", "content-length": "26", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
92622025-08-12T22:53:21.432ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:672 sled = http://[fd00:1122:3344:101::1]:12345
92632025-08-12T22:53:21.434ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 385.214559ms iteration = 3 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":2,"put_config_err":0,"put_config_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"d04697ae-b4b1-419d-b9da-432e45c93990","time":"2025-08-12T22:48:21.758143188Z"},{"operation":"list","target_sled":"d04697ae-b4b1-419d-b9da-432e45c93990","time":"2025-08-12T22:48:21.763211117Z"},{"generation":1,"operation":"put_config","target_sled":"d04697ae-b4b1-419d-b9da-432e45c93990","time":"2025-08-12T22:53:21.431801017Z"},{"operation":"list","target_sled":"d04697ae-b4b1-419d-b9da-432e45c93990","time":"2025-08-12T22:53:21.432205790Z"}]}
92642025-08-12T22:53:21.498ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
92652025-08-12T22:53:21.498ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92662025-08-12T22:53:21.498ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cd4e0a1-f050-4db1-a017-e2c6bc4011fd", "content-length": "26", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
92672025-08-12T22:53:21.498ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92682025-08-12T22:53:21.501ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92692025-08-12T22:53:21.551ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
92702025-08-12T22:53:21.551ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92712025-08-12T22:53:21.552ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f84bfd7d-ae7d-49e6-aff6-25d4ea0a4be0", "content-length": "26", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
92722025-08-12T22:53:21.552ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92732025-08-12T22:53:21.552ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
92742025-08-12T22:53:21.552ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b8246f65-8767-464c-a508-1011bfb48e64", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92752025-08-12T22:53:21.552ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92762025-08-12T22:53:21.556ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
92772025-08-12T22:53:21.557ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "70033572-cf0b-4738-9758-eddcb0759151", "content-length": "691", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
92782025-08-12T22:53:21.557ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
92792025-08-12T22:53:21.557ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
92802025-08-12T22:53:21.557ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
92812025-08-12T22:53:21.559ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92822025-08-12T22:53:21.562ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "025383e9-e7ed-4278-a3a5-182ef4b7b75c", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92832025-08-12T22:53:21.562ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92842025-08-12T22:53:21.571ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
92852025-08-12T22:53:21.571ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92862025-08-12T22:53:21.571ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 523.148951ms iteration = 21 status = {}
92872025-08-12T22:53:21.572ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e92b257-1408-49cb-9b47-a3518d01e08b", "content-length": "26", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
92882025-08-12T22:53:21.572ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92892025-08-12T22:53:21.575ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92902025-08-12T22:53:21.575ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 526.583494ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
92912025-08-12T22:53:21.575ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
92922025-08-12T22:53:21.576ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
92932025-08-12T22:53:21.586ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("1eb181ec-ed88-44de-ad65-703eff3b5c91.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("3c77ad09-57a6-406f-b5e2-457fa564bbd8.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("3f4fdb5b-4ca5-4023-af59-fc1558f8c705.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("597119b2-2f57-4a8b-8151-f6f83b04ea13.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("c58bad20-28d9-47b9-9c71-94d22dadc385.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("c58bad20-28d9-47b9-9c71-94d22dadc385.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::6)) }], valid_until: Instant { tv_sec: 1603, tv_nsec: 819334271 } })
92942025-08-12T22:53:21.587ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
92952025-08-12T22:53:21.587ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
92962025-08-12T22:53:21.587ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
92972025-08-12T22:53:21.587ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6070af5-056b-4ca8-b6f7-cd9532f6ddbf", "content-length": "476", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
92982025-08-12T22:53:21.587ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
92992025-08-12T22:53:21.588ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7247598f-838a-4ea0-b042-7c16c5b1a6e4", "content-length": "734", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93002025-08-12T22:53:21.588ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
93012025-08-12T22:53:21.588ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2449483a-a1ad-417f-bf5f-d782514702ab", "content-length": "111", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93022025-08-12T22:53:21.588ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
93032025-08-12T22:53:21.589ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "60e4c79e-b7d8-4e6b-997e-2fe521bd425b", "content-length": "111", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93042025-08-12T22:53:21.589ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
93052025-08-12T22:53:21.589ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "17630500-4093-4604-94c3-aca83108c882", "content-length": "170", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93062025-08-12T22:53:21.589ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
93072025-08-12T22:53:21.590ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0ace9bb-6733-421d-84f0-686c6e8efa0e", "content-length": "170", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93082025-08-12T22:53:21.590ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
93092025-08-12T22:53:21.591ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5258aef-d037-4329-aca8-22ddd0812b3d", "content-length": "179", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93102025-08-12T22:53:21.591ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
93112025-08-12T22:53:21.591ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2003fd1a-8681-4716-9c09-18a1c6781066", "content-length": "179", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93122025-08-12T22:53:21.591ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
93132025-08-12T22:53:21.591ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "02510f24-b6a7-406c-82a4-0d6580ccacd9", "content-length": "702", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93142025-08-12T22:53:21.591ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
93152025-08-12T22:53:21.592ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd200109-0b6f-40db-b477-c7a8c494f31b", "content-length": "727", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93162025-08-12T22:53:21.592ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
93172025-08-12T22:53:21.592ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e07447c3-52f5-487a-adc8-fa81e7c446a7", "content-length": "729", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93182025-08-12T22:53:21.592ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
93192025-08-12T22:53:21.592ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a01588b1-f129-4ae7-9d98-48f20838dd11", "content-length": "728", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93202025-08-12T22:53:21.592ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
93212025-08-12T22:53:21.593ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3a278e7-8b6b-490b-b405-36d303253255", "content-length": "722", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93222025-08-12T22:53:21.593ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot
93232025-08-12T22:53:21.593ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/active-slot", status: 200, headers: {"content-type": "application/json", "x-request-id": "def575bd-767f-47f4-955d-97e4ee2bcfa4", "content-length": "10", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93242025-08-12T22:53:21.593ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0
93252025-08-12T22:53:21.593ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfba8b44-84fa-492f-870e-49ef8f5a7249", "content-length": "144", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93262025-08-12T22:53:21.593ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1
93272025-08-12T22:53:21.594ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/host-boot-flash/hash/1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba7325bb-ca9f-4ca0-a918-b863683a9fd0", "content-length": "147", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93282025-08-12T22:53:21.594ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
93292025-08-12T22:53:21.594ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a91968b4-03da-4fdb-933b-c6832bcecd7d", "content-length": "109", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93302025-08-12T22:53:21.594ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
93312025-08-12T22:53:21.594ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "859603b1-ac3f-4811-bba7-79e1f2a99ffe", "content-length": "109", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93322025-08-12T22:53:21.594ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
93332025-08-12T22:53:21.595ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a946e6fe-a4f8-4da1-ab73-c2c8dbbfbb9c", "content-length": "169", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93342025-08-12T22:53:21.595ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
93352025-08-12T22:53:21.595ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c242932-ab6c-4a33-bc9e-2dcc2497f6a4", "content-length": "169", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93362025-08-12T22:53:21.595ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
93372025-08-12T22:53:21.596ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "25e4f35d-f1ae-41e7-b183-ea101631319a", "content-length": "178", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93382025-08-12T22:53:21.596ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
93392025-08-12T22:53:21.596ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "54b4173b-a411-48c6-b742-f8e72c97f104", "content-length": "178", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93402025-08-12T22:53:21.596ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
93412025-08-12T22:53:21.596ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f7e86cc-d62f-4317-aba1-36e5d18be312", "content-length": "702", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93422025-08-12T22:53:21.596ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
93432025-08-12T22:53:21.597ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9179cb56-11bf-4aaf-b1bd-845ef3bb9e7e", "content-length": "727", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93442025-08-12T22:53:21.597ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
93452025-08-12T22:53:21.597ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfd03176-c3d6-4c9c-9455-5929b708a3d3", "content-length": "729", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93462025-08-12T22:53:21.597ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
93472025-08-12T22:53:21.597ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "92c0e0a4-62f7-4da3-b3b2-a39c1c2b2326", "content-length": "728", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93482025-08-12T22:53:21.597ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
93492025-08-12T22:53:21.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
93502025-08-12T22:53:21.600ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93512025-08-12T22:53:21.600ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93522025-08-12T22:53:21.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93532025-08-12T22:53:21.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
93542025-08-12T22:53:21.603ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
93552025-08-12T22:53:21.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
93562025-08-12T22:53:21.603ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93572025-08-12T22:53:21.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93582025-08-12T22:53:21.605ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93592025-08-12T22:53:21.606ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93602025-08-12T22:53:21.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
93612025-08-12T22:53:21.608ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
93622025-08-12T22:53:21.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
93632025-08-12T22:53:21.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
93642025-08-12T22:53:21.610ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
93652025-08-12T22:53:21.611ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "651b701c-7cd2-488c-8b69-710e932fb2d7", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93662025-08-12T22:53:21.613ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:491
93672025-08-12T22:53:21.613ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 564.84221ms
93682025-08-12T22:53:21.613ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 564.85283ms iteration = 3 status = {}
93692025-08-12T22:53:21.713ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 665.049372ms iteration = 21 status = {}
93702025-08-12T22:53:21.718ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
93712025-08-12T22:53:21.719ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6e037d16-46f2-44ff-8c02-a76361de0a98", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93722025-08-12T22:53:21.719ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93732025-08-12T22:53:21.724ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a7b6bd28-bc00-4ec1-9b35-33064c857f5b", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93742025-08-12T22:53:21.724ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93752025-08-12T22:53:21.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "88dd0513-e7b0-4432-b704-a7498535d9e7", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93762025-08-12T22:53:21.727ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93772025-08-12T22:53:21.729ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93782025-08-12T22:53:21.729ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 681.07117ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
93792025-08-12T22:53:21.751ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93802025-08-12T22:53:21.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93812025-08-12T22:53:21.754ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 705.992674ms iteration = 21 status = null
93822025-08-12T22:53:21.765ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
93832025-08-12T22:53:21.765ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
93842025-08-12T22:53:21.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93852025-08-12T22:53:21.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93862025-08-12T22:53:21.819ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
93872025-08-12T22:53:21.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93882025-08-12T22:53:21.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93892025-08-12T22:53:21.820ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "861dac22-7da1-4905-8419-7e89cef9e778", "content-length": "88500", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93902025-08-12T22:53:21.822ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
93912025-08-12T22:53:21.822ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
93922025-08-12T22:53:21.822ZDEBGnexus (BackgroundTasks): begin collection from CockroachDB nodes background_task = inventory_collection
93932025-08-12T22:53:21.822ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
93942025-08-12T22:53:21.822ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
93952025-08-12T22:53:21.822ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
93962025-08-12T22:53:21.822ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
93972025-08-12T22:53:21.822ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
93982025-08-12T22:53:21.823ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "846a61f7-eaab-423c-ab01-6d601e7a27d5", "content-length": "64", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
93992025-08-12T22:53:21.823ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/proxy/status/vars
94002025-08-12T22:53:21.823ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c5e51a2-c916-4380-b485-acf85620951f", "content-length": "64", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
94012025-08-12T22:53:21.823ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/proxy/status/vars
94022025-08-12T22:53:21.823ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d71fb12-51a6-4fe3-bc96-c39fec1126f1", "content-length": "64", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
94032025-08-12T22:53:21.823ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e8dc680-3c00-4201-b833-e4ae1c9e9459", "content-length": "64", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
94042025-08-12T22:53:21.823ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1ed107a-f1c1-4273-889c-8da495ba10d1", "content-length": "64", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
94052025-08-12T22:53:21.823ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/proxy/status/vars
94062025-08-12T22:53:21.823ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/proxy/status/vars
94072025-08-12T22:53:21.823ZDEBGnexus (CockroachClusterAdminClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/proxy/status/vars
94082025-08-12T22:53:21.830ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
94092025-08-12T22:53:21.830ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
94102025-08-12T22:53:21.830ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
94112025-08-12T22:53:21.830ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94122025-08-12T22:53:21.830ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94132025-08-12T22:53:21.830ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94142025-08-12T22:53:21.830ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94152025-08-12T22:53:21.830ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94162025-08-12T22:53:21.830ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94172025-08-12T22:53:21.830ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94182025-08-12T22:53:21.831ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
94192025-08-12T22:53:21.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94202025-08-12T22:53:21.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94212025-08-12T22:53:21.834ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
94222025-08-12T22:53:21.834ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94232025-08-12T22:53:21.863ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c9fe184-08be-44da-8205-c3e06fbb1e52", "content-length": "420919", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
94242025-08-12T22:53:21.865ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "761d32bd-5cfc-4e61-904b-50cbb024d84c", "content-length": "392447", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
94252025-08-12T22:53:21.866ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "329f5e62-51f8-447d-b563-4f30b1bbebc8", "content-length": "384064", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
94262025-08-12T22:53:21.875ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "d77a6a77-138e-4830-a737-67ce33144893", "content-length": "388740", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
94272025-08-12T22:53:21.876ZDEBGnexus (CockroachClusterAdminClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/proxy/status/vars", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fd98739-3276-42ed-847a-e88902d66347", "content-length": "386072", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
94282025-08-12T22:53:21.879ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 1
94292025-08-12T22:53:21.879ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 4
94302025-08-12T22:53:21.879ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 5
94312025-08-12T22:53:21.879ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 3
94322025-08-12T22:53:21.879ZDEBGnexus (CockroachClusterAdminClient): Successfully fetched metrics from CockroachDB node node_id = 2
94332025-08-12T22:53:21.911ZDEBGnexus (BackgroundTasks): begin collection from NTP admin (timesync) background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1b]:10123 zone_id = 357c55c9-840c-4cdc-b198-990819e3bc80 (service)
94342025-08-12T22:53:21.911ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None method = GET ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 uri = http://[fd00:1122:3344:101::1b]:10123/timesync
94352025-08-12T22:53:21.915ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection ntp_admin_url = http://[fd00:1122:3344:101::1b]:10123 result = Ok(Response { url: "http://[fd00:1122:3344:101::1b]:10123/timesync", status: 200, headers: {"content-type": "application/json", "x-request-id": "9632e50b-76a3-4d77-b2fa-46b5d6c66e91", "content-length": "127", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
94362025-08-12T22:53:21.916ZDEBGnexus (BackgroundTasks): begin collection from internal DNS servers background_task = inventory_collection
94372025-08-12T22:53:21.963ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5057685f-420b-418d-9129-139c4deb1876", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
94382025-08-12T22:53:21.963ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
94392025-08-12T22:53:21.963ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94402025-08-12T22:53:21.964ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdf12e53-8f78-42d7-895c-8f207d8463f8", "content-length": "682", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
94412025-08-12T22:53:21.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94422025-08-12T22:53:21.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94432025-08-12T22:53:21.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94442025-08-12T22:53:21.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94452025-08-12T22:53:21.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94462025-08-12T22:53:21.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94472025-08-12T22:53:21.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94482025-08-12T22:53:21.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94492025-08-12T22:53:21.981ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 933.054731ms iteration = 21 status = {}
94502025-08-12T22:53:22.022ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 043b8097-0e38-4228-bada-dac70e518148 (service)
94512025-08-12T22:53:22.022ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:1::1]:5353 method = GET uri = http://[fd00:1122:3344:1::1]:5353/config
94522025-08-12T22:53:22.022ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:1::1]:5353 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae7c6c60-d7f6-4f1a-89bc-8ef67a5d20dc", "content-length": "9110", "date": "Tue, 12 Aug 2025 22:53:22 GMT"} })
94532025-08-12T22:53:22.022ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 043b8097-0e38-4228-bada-dac70e518148 (service)
94542025-08-12T22:53:22.024ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 26cd5275-57f5-4466-a94f-f96956f55588 (service)
94552025-08-12T22:53:22.024ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:3::1]:5353 method = GET uri = http://[fd00:1122:3344:3::1]:5353/config
94562025-08-12T22:53:22.025ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:3::1]:5353 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc87ec56-b356-4042-9482-6c01a039b539", "content-length": "9110", "date": "Tue, 12 Aug 2025 22:53:21 GMT"} })
94572025-08-12T22:53:22.025ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 26cd5275-57f5-4466-a94f-f96956f55588 (service)
94582025-08-12T22:53:22.026ZDEBGnexus (BackgroundTasks): begin collection from DNS server background_task = inventory_collection zone_id = 8253fe02-839f-41b4-8a48-6bea72a7f423 (service)
94592025-08-12T22:53:22.026ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None internal_dns_url = http://[fd00:1122:3344:2::1]:5353 method = GET uri = http://[fd00:1122:3344:2::1]:5353/config
94602025-08-12T22:53:22.027ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection internal_dns_url = http://[fd00:1122:3344:2::1]:5353 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4729f3cd-1341-4efe-9534-d54fcc51c3e6", "content-length": "9110", "date": "Tue, 12 Aug 2025 22:53:22 GMT"} })
94612025-08-12T22:53:22.027ZDEBGnexus (BackgroundTasks): finished collection from DNS server background_task = inventory_collection zone_id = 8253fe02-839f-41b4-8a48-6bea72a7f423 (service)
94622025-08-12T22:53:22.029ZDEBGnexus (BackgroundTasks): finished collection from internal DNS servers background_task = inventory_collection
94632025-08-12T22:53:22.029ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
94642025-08-12T22:53:22.031ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94652025-08-12T22:53:22.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94662025-08-12T22:53:22.034ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94672025-08-12T22:53:22.036ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
94682025-08-12T22:53:22.036ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94692025-08-12T22:53:22.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94702025-08-12T22:53:22.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0fe2bdf0-91c1-4987-b600-77c81a80b4ae roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
94712025-08-12T22:53:22.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0fe2bdf0-91c1-4987-b600-77c81a80b4ae resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
94722025-08-12T22:53:22.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0fe2bdf0-91c1-4987-b600-77c81a80b4ae response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
94732025-08-12T22:53:22.239ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = d8071448-f640-4358-b05c-13fe69fad421 file = nexus/db-queries/src/db/datastore/inventory.rs:1614
94742025-08-12T22:53:22.239ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = d8071448-f640-4358-b05c-13fe69fad421 time_started = 2025-08-12 22:53:21.587034 UTC
94752025-08-12T22:53:22.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 15 reason = Dependency
94762025-08-12T22:53:22.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
94772025-08-12T22:53:22.239ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
94782025-08-12T22:53:22.239ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
94792025-08-12T22:53:22.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 10.26\u{b5}s iteration = 15 status = "Disabled"
94802025-08-12T22:53:22.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94812025-08-12T22:53:22.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
94822025-08-12T22:53:22.239ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.190542726s iteration = 3 status = {"collection_id":"d8071448-f640-4358-b05c-13fe69fad421","time_done":"2025-08-12 22:53:22.029626 UTC","time_started":"2025-08-12 22:53:21.587034 UTC"}
94832025-08-12T22:53:22.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
94842025-08-12T22:53:22.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94852025-08-12T22:53:22.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94862025-08-12T22:53:22.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94872025-08-12T22:53:22.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94882025-08-12T22:53:22.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94892025-08-12T22:53:22.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94902025-08-12T22:53:22.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
94912025-08-12T22:53:22.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
94922025-08-12T22:53:22.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
94932025-08-12T22:53:22.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94942025-08-12T22:53:22.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94952025-08-12T22:53:22.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
94962025-08-12T22:53:22.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
94972025-08-12T22:53:22.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94982025-08-12T22:53:22.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94992025-08-12T22:53:22.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95002025-08-12T22:53:22.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95012025-08-12T22:53:22.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
95022025-08-12T22:53:22.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
95032025-08-12T22:53:22.306ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 66.969467ms iteration = 24 status = {"physical_disks_added":0}
95042025-08-12T22:53:22.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95052025-08-12T22:53:22.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
95062025-08-12T22:53:22.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
95072025-08-12T22:53:22.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
95082025-08-12T22:53:22.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95092025-08-12T22:53:22.313ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
95102025-08-12T22:53:22.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
95112025-08-12T22:53:22.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
95122025-08-12T22:53:22.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
95132025-08-12T22:53:22.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
95142025-08-12T22:53:22.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95152025-08-12T22:53:22.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
95162025-08-12T22:53:22.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
95172025-08-12T22:53:22.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
95182025-08-12T22:53:22.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95192025-08-12T22:53:22.323ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
95202025-08-12T22:53:22.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
95212025-08-12T22:53:22.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
95222025-08-12T22:53:22.325ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
95232025-08-12T22:53:22.325ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 86.468618ms iteration = 6 status = {"blueprint_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","inventory_collection_id":"d8071448-f640-4358-b05c-13fe69fad421","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
95242025-08-12T22:53:23.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c656a391-b362-4d33-9d0b-1187ca7cd852 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95252025-08-12T22:53:23.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c656a391-b362-4d33-9d0b-1187ca7cd852 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95262025-08-12T22:53:23.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c656a391-b362-4d33-9d0b-1187ca7cd852 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95272025-08-12T22:53:24.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d4b24836-2d84-473b-b404-8982fc29c464 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95282025-08-12T22:53:24.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d4b24836-2d84-473b-b404-8982fc29c464 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95292025-08-12T22:53:24.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d4b24836-2d84-473b-b404-8982fc29c464 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95302025-08-12T22:53:25.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1c4c2224-7b01-4a75-8543-c008ee2f292b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95312025-08-12T22:53:25.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1c4c2224-7b01-4a75-8543-c008ee2f292b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95322025-08-12T22:53:25.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1c4c2224-7b01-4a75-8543-c008ee2f292b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95332025-08-12T22:53:26.049ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 122 reason = Timeout
95342025-08-12T22:53:26.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
95352025-08-12T22:53:26.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
95362025-08-12T22:53:26.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95372025-08-12T22:53:26.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
95382025-08-12T22:53:26.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
95392025-08-12T22:53:26.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
95402025-08-12T22:53:26.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
95412025-08-12T22:53:26.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.205371ms iteration = 122 status = {"chicken_switches_updated":false}
95422025-08-12T22:53:26.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 51027f24-69b5-47d2-aa9d-7c9c0aa6cf87 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95432025-08-12T22:53:26.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 51027f24-69b5-47d2-aa9d-7c9c0aa6cf87 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95442025-08-12T22:53:26.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2692 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 51027f24-69b5-47d2-aa9d-7c9c0aa6cf87 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95452025-08-12T22:53:27.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7e0191d6-0dc9-42a1-bb0f-1911fbc63649 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95462025-08-12T22:53:27.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7e0191d6-0dc9-42a1-bb0f-1911fbc63649 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95472025-08-12T22:53:27.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7e0191d6-0dc9-42a1-bb0f-1911fbc63649 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95482025-08-12T22:53:28.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 22e24529-003b-4857-b054-d3a6d5decc63 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95492025-08-12T22:53:28.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 22e24529-003b-4857-b054-d3a6d5decc63 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95502025-08-12T22:53:28.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 22e24529-003b-4857-b054-d3a6d5decc63 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95512025-08-12T22:53:28.837ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 518 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = bb790f0e-90c1-4b20-af77-41762e8605d2 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
95522025-08-12T22:53:29.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0df3077d-b663-4970-ba6d-128c5cb486cd roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95532025-08-12T22:53:29.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0df3077d-b663-4970-ba6d-128c5cb486cd resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95542025-08-12T22:53:29.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0df3077d-b663-4970-ba6d-128c5cb486cd response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95552025-08-12T22:53:30.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 149f9bcf-e97f-43b3-8dcd-c1dba18a7f53 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95562025-08-12T22:53:30.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 149f9bcf-e97f-43b3-8dcd-c1dba18a7f53 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95572025-08-12T22:53:30.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 149f9bcf-e97f-43b3-8dcd-c1dba18a7f53 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95582025-08-12T22:53:31.048ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
95592025-08-12T22:53:31.048ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
95602025-08-12T22:53:31.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95612025-08-12T22:53:31.049ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 123 reason = Timeout
95622025-08-12T22:53:31.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95632025-08-12T22:53:31.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
95642025-08-12T22:53:31.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
95652025-08-12T22:53:31.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95662025-08-12T22:53:31.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95672025-08-12T22:53:31.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95682025-08-12T22:53:31.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95692025-08-12T22:53:31.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95702025-08-12T22:53:31.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95712025-08-12T22:53:31.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.759157ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95722025-08-12T22:53:31.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95732025-08-12T22:53:31.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95742025-08-12T22:53:31.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
95752025-08-12T22:53:31.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95762025-08-12T22:53:31.055ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
95772025-08-12T22:53:31.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
95782025-08-12T22:53:31.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
95792025-08-12T22:53:31.057ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.070889ms iteration = 123 status = {"chicken_switches_updated":false}
95802025-08-12T22:53:31.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95812025-08-12T22:53:31.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95822025-08-12T22:53:31.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95832025-08-12T22:53:31.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
95842025-08-12T22:53:31.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95852025-08-12T22:53:31.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95862025-08-12T22:53:31.074ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
95872025-08-12T22:53:31.074ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.56484ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
95882025-08-12T22:53:31.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ee726986-9aac-4ebc-b191-db6200c63efd roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95892025-08-12T22:53:31.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ee726986-9aac-4ebc-b191-db6200c63efd resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95902025-08-12T22:53:31.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ee726986-9aac-4ebc-b191-db6200c63efd response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95912025-08-12T22:53:32.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 267fa74d-12b6-477c-b369-b43e323961b1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95922025-08-12T22:53:32.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 267fa74d-12b6-477c-b369-b43e323961b1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95932025-08-12T22:53:32.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 267fa74d-12b6-477c-b369-b43e323961b1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95942025-08-12T22:53:33.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5aaf1c91-1550-4a6b-80c5-4c9c225c3dda roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95952025-08-12T22:53:33.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5aaf1c91-1550-4a6b-80c5-4c9c225c3dda resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95962025-08-12T22:53:33.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5aaf1c91-1550-4a6b-80c5-4c9c225c3dda response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95972025-08-12T22:53:34.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = afb940db-4d0b-4bb8-887c-7fb47d2fd700 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95982025-08-12T22:53:34.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = afb940db-4d0b-4bb8-887c-7fb47d2fd700 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
95992025-08-12T22:53:34.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = afb940db-4d0b-4bb8-887c-7fb47d2fd700 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96002025-08-12T22:53:35.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9536352b-b78b-40f2-bd8f-ff794bd8a57c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96012025-08-12T22:53:35.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9536352b-b78b-40f2-bd8f-ff794bd8a57c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96022025-08-12T22:53:35.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9536352b-b78b-40f2-bd8f-ff794bd8a57c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96032025-08-12T22:53:36.049ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 124 reason = Timeout
96042025-08-12T22:53:36.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
96052025-08-12T22:53:36.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
96062025-08-12T22:53:36.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96072025-08-12T22:53:36.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
96082025-08-12T22:53:36.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
96092025-08-12T22:53:36.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
96102025-08-12T22:53:36.055ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
96112025-08-12T22:53:36.055ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.039349ms iteration = 124 status = {"chicken_switches_updated":false}
96122025-08-12T22:53:36.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a04c15f0-6be2-42e3-8d55-7a57ab5b1ec1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96132025-08-12T22:53:36.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a04c15f0-6be2-42e3-8d55-7a57ab5b1ec1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96142025-08-12T22:53:36.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a04c15f0-6be2-42e3-8d55-7a57ab5b1ec1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96152025-08-12T22:53:37.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ab9fd3ae-632c-4e38-b87b-b29c5d15da5c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96162025-08-12T22:53:37.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ab9fd3ae-632c-4e38-b87b-b29c5d15da5c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96172025-08-12T22:53:37.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ab9fd3ae-632c-4e38-b87b-b29c5d15da5c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96182025-08-12T22:53:38.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c9dfef8d-9a03-49a9-967a-200ecad01c3e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96192025-08-12T22:53:38.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c9dfef8d-9a03-49a9-967a-200ecad01c3e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96202025-08-12T22:53:38.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c9dfef8d-9a03-49a9-967a-200ecad01c3e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96212025-08-12T22:53:38.837ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 632 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 717d65c2-2707-41c3-8a14-31a7c742c013 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
96222025-08-12T22:53:39.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9aaf6802-d4fa-4354-bc02-d7fdec150d0b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96232025-08-12T22:53:39.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9aaf6802-d4fa-4354-bc02-d7fdec150d0b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96242025-08-12T22:53:39.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9aaf6802-d4fa-4354-bc02-d7fdec150d0b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96252025-08-12T22:53:40.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8f4e1c7f-4c80-4568-a44a-c8b563cad392 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96262025-08-12T22:53:40.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8f4e1c7f-4c80-4568-a44a-c8b563cad392 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96272025-08-12T22:53:40.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8f4e1c7f-4c80-4568-a44a-c8b563cad392 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96282025-08-12T22:53:41.049ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
96292025-08-12T22:53:41.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96302025-08-12T22:53:41.049ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
96312025-08-12T22:53:41.049ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 125 reason = Timeout
96322025-08-12T22:53:41.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
96332025-08-12T22:53:41.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96342025-08-12T22:53:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96352025-08-12T22:53:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
96362025-08-12T22:53:41.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96372025-08-12T22:53:41.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96382025-08-12T22:53:41.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96392025-08-12T22:53:41.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96402025-08-12T22:53:41.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96412025-08-12T22:53:41.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.886708ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96422025-08-12T22:53:41.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
96432025-08-12T22:53:41.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
96442025-08-12T22:53:41.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96452025-08-12T22:53:41.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96462025-08-12T22:53:41.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
96472025-08-12T22:53:41.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96482025-08-12T22:53:41.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96492025-08-12T22:53:41.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
96502025-08-12T22:53:41.056ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.272211ms iteration = 125 status = {"chicken_switches_updated":false}
96512025-08-12T22:53:41.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96522025-08-12T22:53:41.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96532025-08-12T22:53:41.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
96542025-08-12T22:53:41.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96552025-08-12T22:53:41.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96562025-08-12T22:53:41.074ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
96572025-08-12T22:53:41.074ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.763703ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
96582025-08-12T22:53:41.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b87d8a0a-5c0e-4ade-b25b-1fccae847af5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96592025-08-12T22:53:41.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b87d8a0a-5c0e-4ade-b25b-1fccae847af5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96602025-08-12T22:53:41.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b87d8a0a-5c0e-4ade-b25b-1fccae847af5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96612025-08-12T22:53:42.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6c676724-95ed-4e28-a54e-7f66283f9fbd roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96622025-08-12T22:53:42.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6c676724-95ed-4e28-a54e-7f66283f9fbd resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96632025-08-12T22:53:42.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6c676724-95ed-4e28-a54e-7f66283f9fbd response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96642025-08-12T22:53:43.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a1d186f6-9821-449f-bab1-70134cbe261e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96652025-08-12T22:53:43.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a1d186f6-9821-449f-bab1-70134cbe261e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96662025-08-12T22:53:43.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a1d186f6-9821-449f-bab1-70134cbe261e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96672025-08-12T22:53:44.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ac88d79a-4610-4f44-b877-4e2b51219027 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96682025-08-12T22:53:44.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ac88d79a-4610-4f44-b877-4e2b51219027 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96692025-08-12T22:53:44.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ac88d79a-4610-4f44-b877-4e2b51219027 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96702025-08-12T22:53:45.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c6ee9904-576b-42d4-939d-007564f3e54d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96712025-08-12T22:53:45.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c6ee9904-576b-42d4-939d-007564f3e54d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96722025-08-12T22:53:45.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c6ee9904-576b-42d4-939d-007564f3e54d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96732025-08-12T22:53:46.049ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 126 reason = Timeout
96742025-08-12T22:53:46.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
96752025-08-12T22:53:46.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
96762025-08-12T22:53:46.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96772025-08-12T22:53:46.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
96782025-08-12T22:53:46.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
96792025-08-12T22:53:46.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
96802025-08-12T22:53:46.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
96812025-08-12T22:53:46.056ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.883447ms iteration = 126 status = {"chicken_switches_updated":false}
96822025-08-12T22:53:46.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cf5ad993-4981-4d6a-9105-8597728199e6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96832025-08-12T22:53:46.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cf5ad993-4981-4d6a-9105-8597728199e6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96842025-08-12T22:53:46.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cf5ad993-4981-4d6a-9105-8597728199e6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96852025-08-12T22:53:47.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7b3e297e-b9dd-48ae-910f-cd3c5f93ff07 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96862025-08-12T22:53:47.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7b3e297e-b9dd-48ae-910f-cd3c5f93ff07 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96872025-08-12T22:53:47.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7b3e297e-b9dd-48ae-910f-cd3c5f93ff07 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96882025-08-12T22:53:48.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c88a9832-f1be-448f-b4ac-f9d717e4842f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96892025-08-12T22:53:48.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c88a9832-f1be-448f-b4ac-f9d717e4842f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96902025-08-12T22:53:48.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c88a9832-f1be-448f-b4ac-f9d717e4842f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96912025-08-12T22:53:48.837ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 859 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = a998786c-a77e-4a45-a40b-6710325b2c60 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
96922025-08-12T22:53:49.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2203126f-d524-4733-a361-d9cb24b6fe93 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96932025-08-12T22:53:49.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2203126f-d524-4733-a361-d9cb24b6fe93 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96942025-08-12T22:53:49.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2203126f-d524-4733-a361-d9cb24b6fe93 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96952025-08-12T22:53:50.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a7f14585-b075-47ba-a774-62576d25178e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96962025-08-12T22:53:50.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a7f14585-b075-47ba-a774-62576d25178e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96972025-08-12T22:53:50.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a7f14585-b075-47ba-a774-62576d25178e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
96982025-08-12T22:53:51.048ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
96992025-08-12T22:53:51.048ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
97002025-08-12T22:53:51.048ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
97012025-08-12T22:53:51.048ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
97022025-08-12T22:53:51.048ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97032025-08-12T22:53:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
97042025-08-12T22:53:51.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97052025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 22 reason = Timeout
97062025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
97072025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 12.71\u{b5}s iteration = 22 status = {"disabled":true,"errors":[],"sps":[]}
97082025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
97092025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
97102025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97112025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
97122025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97132025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
97142025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97152025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
97162025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97172025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
97182025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
97192025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
97202025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97212025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97222025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
97232025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97242025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
97252025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
97262025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
97272025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
97282025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97292025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97302025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
97312025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
97322025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97332025-08-12T22:53:51.049ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97342025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97352025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
97362025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
97372025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97382025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97392025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 127 reason = Timeout
97402025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
97412025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
97422025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97432025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97442025-08-12T22:53:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
97452025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97462025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97472025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97482025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97492025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97502025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97512025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97522025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
97532025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97542025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97552025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97562025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97572025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97582025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
97592025-08-12T22:53:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97602025-08-12T22:53:51.051ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1633, tv_nsec: 283834878 } })
97612025-08-12T22:53:51.051ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
97622025-08-12T22:53:51.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97632025-08-12T22:53:51.051ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1633, tv_nsec: 284387904 } })
97642025-08-12T22:53:51.052ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
97652025-08-12T22:53:51.052ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.711887ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
97662025-08-12T22:53:51.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97672025-08-12T22:53:51.052ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97682025-08-12T22:53:51.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97692025-08-12T22:53:51.052ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.783838ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
97702025-08-12T22:53:51.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97712025-08-12T22:53:51.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97722025-08-12T22:53:51.052ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97732025-08-12T22:53:51.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97742025-08-12T22:53:51.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97752025-08-12T22:53:51.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97762025-08-12T22:53:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97772025-08-12T22:53:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97782025-08-12T22:53:51.053ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.861167ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97792025-08-12T22:53:51.054ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97802025-08-12T22:53:51.054ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.916848ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97812025-08-12T22:53:51.054ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97822025-08-12T22:53:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97832025-08-12T22:53:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97842025-08-12T22:53:51.055ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 5.769637ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
97852025-08-12T22:53:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97862025-08-12T22:53:51.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97872025-08-12T22:53:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97882025-08-12T22:53:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97892025-08-12T22:53:51.057ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97902025-08-12T22:53:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97912025-08-12T22:53:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97922025-08-12T22:53:51.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97932025-08-12T22:53:51.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97942025-08-12T22:53:51.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97952025-08-12T22:53:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97962025-08-12T22:53:51.057ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97972025-08-12T22:53:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97982025-08-12T22:53:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97992025-08-12T22:53:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98002025-08-12T22:53:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98012025-08-12T22:53:51.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98022025-08-12T22:53:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
98032025-08-12T22:53:51.058ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
98042025-08-12T22:53:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
98052025-08-12T22:53:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98062025-08-12T22:53:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
98072025-08-12T22:53:51.059ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98082025-08-12T22:53:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98092025-08-12T22:53:51.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98102025-08-12T22:53:51.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98112025-08-12T22:53:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98122025-08-12T22:53:51.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98132025-08-12T22:53:51.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98142025-08-12T22:53:51.060ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1633, tv_nsec: 293093859 } })
98152025-08-12T22:53:51.060ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
98162025-08-12T22:53:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98172025-08-12T22:53:51.060ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 10.804786ms iteration = 127 status = {"chicken_switches_updated":false}
98182025-08-12T22:53:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98192025-08-12T22:53:51.060ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
98202025-08-12T22:53:51.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98212025-08-12T22:53:51.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98222025-08-12T22:53:51.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98232025-08-12T22:53:51.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98242025-08-12T22:53:51.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98252025-08-12T22:53:51.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98262025-08-12T22:53:51.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98272025-08-12T22:53:51.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98282025-08-12T22:53:51.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98292025-08-12T22:53:51.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98302025-08-12T22:53:51.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
98312025-08-12T22:53:51.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98322025-08-12T22:53:51.065ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98332025-08-12T22:53:51.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98342025-08-12T22:53:51.065ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 15.816325ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98352025-08-12T22:53:51.083ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
98362025-08-12T22:53:51.083ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.285307ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
98372025-08-12T22:53:51.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 50.027141ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
98382025-08-12T22:53:51.100ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98392025-08-12T22:53:51.100ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
98402025-08-12T22:53:51.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98412025-08-12T22:53:51.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98422025-08-12T22:53:51.101ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 52.203252ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98432025-08-12T22:53:51.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98442025-08-12T22:53:51.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98452025-08-12T22:53:51.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 55.109871ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98462025-08-12T22:53:51.107ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98472025-08-12T22:53:51.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98482025-08-12T22:53:51.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98492025-08-12T22:53:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98502025-08-12T22:53:51.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98512025-08-12T22:53:51.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98522025-08-12T22:53:51.112ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98532025-08-12T22:53:51.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
98542025-08-12T22:53:51.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98552025-08-12T22:53:51.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98562025-08-12T22:53:51.117ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 67.498522ms iteration = 22 status = 0
98572025-08-12T22:53:51.119ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98582025-08-12T22:53:51.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98592025-08-12T22:53:51.120ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98602025-08-12T22:53:51.122ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98612025-08-12T22:53:51.122ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98622025-08-12T22:53:51.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98632025-08-12T22:53:51.124ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98642025-08-12T22:53:51.125ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98652025-08-12T22:53:51.125ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98662025-08-12T22:53:51.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98672025-08-12T22:53:51.139ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98682025-08-12T22:53:51.139ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98692025-08-12T22:53:51.139ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98702025-08-12T22:53:51.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98712025-08-12T22:53:51.141ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98722025-08-12T22:53:51.141ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98732025-08-12T22:53:51.141ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 91.520437ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98742025-08-12T22:53:51.145ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98752025-08-12T22:53:51.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
98762025-08-12T22:53:51.147ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98772025-08-12T22:53:51.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98782025-08-12T22:53:51.159ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
98792025-08-12T22:53:51.159ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98802025-08-12T22:53:51.161ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "56bce25a-92fe-4f4d-8b44-25e35e49f369", "content-length": "26", "date": "Tue, 12 Aug 2025 22:53:51 GMT"} })
98812025-08-12T22:53:51.161ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98822025-08-12T22:53:51.161ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98832025-08-12T22:53:51.163ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
98842025-08-12T22:53:51.164ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98852025-08-12T22:53:51.164ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8105f835-e7bd-413e-8d38-7ac7d4076131", "content-length": "26", "date": "Tue, 12 Aug 2025 22:53:51 GMT"} })
98862025-08-12T22:53:51.164ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98872025-08-12T22:53:51.165ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98882025-08-12T22:53:51.187ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 137.825682ms iteration = 25 status = {"physical_disks_added":0}
98892025-08-12T22:53:51.188ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
98902025-08-12T22:53:51.188ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 138.499578ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
98912025-08-12T22:53:51.275ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98922025-08-12T22:53:51.276ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c60eeed8-55f8-47a3-992f-6fe1e1165282", "content-length": "691", "date": "Tue, 12 Aug 2025 22:53:51 GMT"} })
98932025-08-12T22:53:51.276ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
98942025-08-12T22:53:51.276ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
98952025-08-12T22:53:51.276ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
98962025-08-12T22:53:51.277ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 227.664303ms iteration = 22 status = {}
98972025-08-12T22:53:51.301ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 253.317454ms iteration = 22 status = {}
98982025-08-12T22:53:51.312ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
98992025-08-12T22:53:51.312ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99002025-08-12T22:53:51.312ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "845d1105-564d-49c7-a180-46e6d579f88c", "content-length": "26", "date": "Tue, 12 Aug 2025 22:53:51 GMT"} })
99012025-08-12T22:53:51.312ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99022025-08-12T22:53:51.312ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99032025-08-12T22:53:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99042025-08-12T22:53:51.313ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
99052025-08-12T22:53:51.314ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 266.352762ms iteration = 22 status = null
99062025-08-12T22:53:51.320ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99072025-08-12T22:53:51.320ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99082025-08-12T22:53:51.320ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f1b3821-896e-421e-80b6-5826add9fd0c", "content-length": "372", "date": "Tue, 12 Aug 2025 22:53:51 GMT"} })
99092025-08-12T22:53:51.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99102025-08-12T22:53:51.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99112025-08-12T22:53:51.334ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99122025-08-12T22:53:51.334ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99132025-08-12T22:53:51.334ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3cf2f676-74c2-4531-97f4-8744e1033440", "date": "Tue, 12 Aug 2025 22:53:51 GMT"} })
99142025-08-12T22:53:51.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99152025-08-12T22:53:51.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99162025-08-12T22:53:51.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99172025-08-12T22:53:51.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99182025-08-12T22:53:51.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99192025-08-12T22:53:51.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99202025-08-12T22:53:51.343ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99212025-08-12T22:53:51.343ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99222025-08-12T22:53:51.343ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0ce2b62d-e7b4-4dd7-9eb1-100fc6e6dbea", "date": "Tue, 12 Aug 2025 22:53:51 GMT"} })
99232025-08-12T22:53:51.345ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 295.899462ms iteration = 22 status = {}
99242025-08-12T22:53:51.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99252025-08-12T22:53:51.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99262025-08-12T22:53:51.425ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
99272025-08-12T22:53:51.425ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99282025-08-12T22:53:51.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99292025-08-12T22:53:51.435ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
99302025-08-12T22:53:51.435ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
99312025-08-12T22:53:51.435ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99322025-08-12T22:53:51.435ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99332025-08-12T22:53:51.435ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99342025-08-12T22:53:51.435ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99352025-08-12T22:53:51.435ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99362025-08-12T22:53:51.435ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99372025-08-12T22:53:51.435ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99382025-08-12T22:53:51.435ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99392025-08-12T22:53:51.435ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
99402025-08-12T22:53:51.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99412025-08-12T22:53:51.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99422025-08-12T22:53:51.438ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
99432025-08-12T22:53:51.438ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99442025-08-12T22:53:51.551ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e6b688c5-7108-472f-b571-fbd0f37f11e0", "date": "Tue, 12 Aug 2025 22:53:51 GMT"} })
99452025-08-12T22:53:51.551ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
99462025-08-12T22:53:51.551ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99472025-08-12T22:53:51.552ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8be585bb-6014-4eb6-9e68-9c0383e27323", "content-length": "682", "date": "Tue, 12 Aug 2025 22:53:51 GMT"} })
99482025-08-12T22:53:51.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99492025-08-12T22:53:51.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99502025-08-12T22:53:51.556ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99512025-08-12T22:53:51.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99522025-08-12T22:53:51.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99532025-08-12T22:53:51.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99542025-08-12T22:53:51.562ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99552025-08-12T22:53:51.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99562025-08-12T22:53:51.569ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 519.561246ms iteration = 22 status = {}
99572025-08-12T22:53:51.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2fc77703-b5fb-4205-8176-9dc5a549d205 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99582025-08-12T22:53:51.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2fc77703-b5fb-4205-8176-9dc5a549d205 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99592025-08-12T22:53:51.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2fc77703-b5fb-4205-8176-9dc5a549d205 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99602025-08-12T22:53:52.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d7fddea6-fc67-459a-9102-ed82573874ca roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99612025-08-12T22:53:52.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d7fddea6-fc67-459a-9102-ed82573874ca resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99622025-08-12T22:53:52.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d7fddea6-fc67-459a-9102-ed82573874ca response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99632025-08-12T22:53:53.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9360b2d2-9617-471f-87af-60be6ec8e427 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99642025-08-12T22:53:53.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9360b2d2-9617-471f-87af-60be6ec8e427 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99652025-08-12T22:53:53.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9360b2d2-9617-471f-87af-60be6ec8e427 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99662025-08-12T22:53:54.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bbc3676c-f6bd-46ac-b94a-da792add0cd4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99672025-08-12T22:53:54.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bbc3676c-f6bd-46ac-b94a-da792add0cd4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99682025-08-12T22:53:54.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bbc3676c-f6bd-46ac-b94a-da792add0cd4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99692025-08-12T22:53:55.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = af388deb-b983-4e0e-a157-b99039fe37b8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99702025-08-12T22:53:55.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = af388deb-b983-4e0e-a157-b99039fe37b8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99712025-08-12T22:53:55.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = af388deb-b983-4e0e-a157-b99039fe37b8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99722025-08-12T22:53:56.049ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 128 reason = Timeout
99732025-08-12T22:53:56.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
99742025-08-12T22:53:56.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
99752025-08-12T22:53:56.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99762025-08-12T22:53:56.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
99772025-08-12T22:53:56.055ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
99782025-08-12T22:53:56.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
99792025-08-12T22:53:56.057ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
99802025-08-12T22:53:56.057ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.832757ms iteration = 128 status = {"chicken_switches_updated":false}
99812025-08-12T22:53:56.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f1b7a015-f3de-4f98-8181-1db77d115b1a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99822025-08-12T22:53:56.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f1b7a015-f3de-4f98-8181-1db77d115b1a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99832025-08-12T22:53:56.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f1b7a015-f3de-4f98-8181-1db77d115b1a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99842025-08-12T22:53:57.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1b2754eb-7358-4813-a260-fbfb20bf31c0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99852025-08-12T22:53:57.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1b2754eb-7358-4813-a260-fbfb20bf31c0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99862025-08-12T22:53:57.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1b2754eb-7358-4813-a260-fbfb20bf31c0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99872025-08-12T22:53:58.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f3559aa4-f836-4548-83fe-3e87a67d51ce roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99882025-08-12T22:53:58.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f3559aa4-f836-4548-83fe-3e87a67d51ce resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99892025-08-12T22:53:58.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f3559aa4-f836-4548-83fe-3e87a67d51ce response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99902025-08-12T22:53:58.836ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 541 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 064aae2a-715f-4c72-a209-4f358f954289 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
99912025-08-12T22:53:59.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 57243e97-13bc-4911-ae1d-581eb7a5ef7b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99922025-08-12T22:53:59.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 57243e97-13bc-4911-ae1d-581eb7a5ef7b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99932025-08-12T22:53:59.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 57243e97-13bc-4911-ae1d-581eb7a5ef7b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99942025-08-12T22:54:00.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 00d7ba09-6fc0-43d6-b896-fd5a2caef6cc roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99952025-08-12T22:54:00.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 00d7ba09-6fc0-43d6-b896-fd5a2caef6cc resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99962025-08-12T22:54:00.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 00d7ba09-6fc0-43d6-b896-fd5a2caef6cc response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
99972025-08-12T22:54:01.049ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
99982025-08-12T22:54:01.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99992025-08-12T22:54:01.049ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
100002025-08-12T22:54:01.049ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 129 reason = Timeout
100012025-08-12T22:54:01.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
100022025-08-12T22:54:01.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100032025-08-12T22:54:01.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100042025-08-12T22:54:01.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100052025-08-12T22:54:01.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
100062025-08-12T22:54:01.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100072025-08-12T22:54:01.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100082025-08-12T22:54:01.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100092025-08-12T22:54:01.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100102025-08-12T22:54:01.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.380153ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100112025-08-12T22:54:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
100122025-08-12T22:54:01.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
100132025-08-12T22:54:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100142025-08-12T22:54:01.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100152025-08-12T22:54:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
100162025-08-12T22:54:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100172025-08-12T22:54:01.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
100182025-08-12T22:54:01.056ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.450773ms iteration = 129 status = {"chicken_switches_updated":false}
100192025-08-12T22:54:01.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100202025-08-12T22:54:01.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100212025-08-12T22:54:01.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100222025-08-12T22:54:01.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
100232025-08-12T22:54:01.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100242025-08-12T22:54:01.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100252025-08-12T22:54:01.073ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
100262025-08-12T22:54:01.073ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.123137ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
100272025-08-12T22:54:01.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b9864a4-2c27-4bba-a8a0-5044255e2548 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100282025-08-12T22:54:01.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b9864a4-2c27-4bba-a8a0-5044255e2548 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100292025-08-12T22:54:01.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b9864a4-2c27-4bba-a8a0-5044255e2548 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100302025-08-12T22:54:02.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c58a1f28-a2f8-49ad-a3f1-4937540f31b2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100312025-08-12T22:54:02.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c58a1f28-a2f8-49ad-a3f1-4937540f31b2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100322025-08-12T22:54:02.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c58a1f28-a2f8-49ad-a3f1-4937540f31b2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100332025-08-12T22:54:03.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3b132e95-a936-4c31-9b79-228f98d788f5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100342025-08-12T22:54:03.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3b132e95-a936-4c31-9b79-228f98d788f5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100352025-08-12T22:54:03.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3b132e95-a936-4c31-9b79-228f98d788f5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100362025-08-12T22:54:04.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 19e63f31-4574-486f-83a6-d4b9c1fc8c72 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100372025-08-12T22:54:04.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 19e63f31-4574-486f-83a6-d4b9c1fc8c72 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100382025-08-12T22:54:04.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 19e63f31-4574-486f-83a6-d4b9c1fc8c72 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100392025-08-12T22:54:05.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 83d0ca22-dde4-4123-9625-1973fdb53e01 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100402025-08-12T22:54:05.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 83d0ca22-dde4-4123-9625-1973fdb53e01 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100412025-08-12T22:54:05.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 83d0ca22-dde4-4123-9625-1973fdb53e01 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100422025-08-12T22:54:06.049ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 130 reason = Timeout
100432025-08-12T22:54:06.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
100442025-08-12T22:54:06.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
100452025-08-12T22:54:06.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100462025-08-12T22:54:06.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
100472025-08-12T22:54:06.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
100482025-08-12T22:54:06.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
100492025-08-12T22:54:06.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
100502025-08-12T22:54:06.056ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.636545ms iteration = 130 status = {"chicken_switches_updated":false}
100512025-08-12T22:54:06.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 186268dc-d28f-4d0b-b117-cf426c5db92b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100522025-08-12T22:54:06.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 186268dc-d28f-4d0b-b117-cf426c5db92b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100532025-08-12T22:54:06.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 186268dc-d28f-4d0b-b117-cf426c5db92b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100542025-08-12T22:54:07.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fd052e09-9dd8-4ccd-aae0-a77a1102ca70 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100552025-08-12T22:54:07.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fd052e09-9dd8-4ccd-aae0-a77a1102ca70 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100562025-08-12T22:54:07.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fd052e09-9dd8-4ccd-aae0-a77a1102ca70 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100572025-08-12T22:54:08.837ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 671 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 19d1221b-3bf1-4840-8aa8-a1dce06ee8f4 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
100582025-08-12T22:54:08.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 85830e17-f59d-415d-9dae-7ff5a2228456 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100592025-08-12T22:54:08.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 85830e17-f59d-415d-9dae-7ff5a2228456 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100602025-08-12T22:54:08.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 85830e17-f59d-415d-9dae-7ff5a2228456 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100612025-08-12T22:54:09.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f16dd486-3ff2-44e9-afef-a8eaaa9d22f7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100622025-08-12T22:54:09.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f16dd486-3ff2-44e9-afef-a8eaaa9d22f7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100632025-08-12T22:54:09.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f16dd486-3ff2-44e9-afef-a8eaaa9d22f7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100642025-08-12T22:54:10.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7809bd9b-5396-4e03-8ce8-b63c2d7f3b1c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100652025-08-12T22:54:10.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7809bd9b-5396-4e03-8ce8-b63c2d7f3b1c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100662025-08-12T22:54:10.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7809bd9b-5396-4e03-8ce8-b63c2d7f3b1c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100672025-08-12T22:54:11.049ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
100682025-08-12T22:54:11.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100692025-08-12T22:54:11.050ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
100702025-08-12T22:54:11.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100712025-08-12T22:54:11.050ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 131 reason = Timeout
100722025-08-12T22:54:11.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
100732025-08-12T22:54:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100742025-08-12T22:54:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100752025-08-12T22:54:11.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
100762025-08-12T22:54:11.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100772025-08-12T22:54:11.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100782025-08-12T22:54:11.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100792025-08-12T22:54:11.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100802025-08-12T22:54:11.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
100812025-08-12T22:54:11.055ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
100822025-08-12T22:54:11.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100832025-08-12T22:54:11.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
100842025-08-12T22:54:11.057ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
100852025-08-12T22:54:11.057ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.571074ms iteration = 131 status = {"chicken_switches_updated":false}
100862025-08-12T22:54:11.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100872025-08-12T22:54:11.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100882025-08-12T22:54:11.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100892025-08-12T22:54:11.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
100902025-08-12T22:54:11.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100912025-08-12T22:54:11.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100922025-08-12T22:54:11.080ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
100932025-08-12T22:54:11.080ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.089045ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
100942025-08-12T22:54:11.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100952025-08-12T22:54:11.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100962025-08-12T22:54:11.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.73004ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100972025-08-12T22:54:11.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4c17e794-7f91-4016-a6d9-ddd7e0694653 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100982025-08-12T22:54:11.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4c17e794-7f91-4016-a6d9-ddd7e0694653 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
100992025-08-12T22:54:11.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4c17e794-7f91-4016-a6d9-ddd7e0694653 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101002025-08-12T22:54:12.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d339d076-0713-40a5-bb87-d66f952778bd roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101012025-08-12T22:54:12.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d339d076-0713-40a5-bb87-d66f952778bd resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101022025-08-12T22:54:12.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d339d076-0713-40a5-bb87-d66f952778bd response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101032025-08-12T22:54:13.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e5f874c8-cf0f-4c6e-a303-f48028ce6865 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101042025-08-12T22:54:13.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e5f874c8-cf0f-4c6e-a303-f48028ce6865 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101052025-08-12T22:54:13.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e5f874c8-cf0f-4c6e-a303-f48028ce6865 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101062025-08-12T22:54:15.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c2b71b0e-8fcf-4344-a9fa-ba0c9806b97b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101072025-08-12T22:54:15.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c2b71b0e-8fcf-4344-a9fa-ba0c9806b97b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101082025-08-12T22:54:15.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c2b71b0e-8fcf-4344-a9fa-ba0c9806b97b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101092025-08-12T22:54:16.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d9a5c9b9-d63b-4255-b859-2bf292ca51a8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101102025-08-12T22:54:16.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d9a5c9b9-d63b-4255-b859-2bf292ca51a8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101112025-08-12T22:54:16.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d9a5c9b9-d63b-4255-b859-2bf292ca51a8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101122025-08-12T22:54:16.050ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 132 reason = Timeout
101132025-08-12T22:54:16.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
101142025-08-12T22:54:16.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
101152025-08-12T22:54:16.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101162025-08-12T22:54:16.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
101172025-08-12T22:54:16.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
101182025-08-12T22:54:16.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
101192025-08-12T22:54:16.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
101202025-08-12T22:54:16.056ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.656796ms iteration = 132 status = {"chicken_switches_updated":false}
101212025-08-12T22:54:17.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c4257d61-014f-48df-97d0-29b3d94acbe0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101222025-08-12T22:54:17.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c4257d61-014f-48df-97d0-29b3d94acbe0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101232025-08-12T22:54:17.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2587 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c4257d61-014f-48df-97d0-29b3d94acbe0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101242025-08-12T22:54:18.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e953a5ae-b1d2-42fd-852e-bbac55e38c0b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101252025-08-12T22:54:18.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e953a5ae-b1d2-42fd-852e-bbac55e38c0b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101262025-08-12T22:54:18.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e953a5ae-b1d2-42fd-852e-bbac55e38c0b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101272025-08-12T22:54:18.837ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 806 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 2e2be2b1-21ae-4ec0-bcf6-0a8fa4cf3011 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
101282025-08-12T22:54:19.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 945dfe47-baea-4f9f-8bcd-7cc877014446 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101292025-08-12T22:54:19.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 945dfe47-baea-4f9f-8bcd-7cc877014446 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101302025-08-12T22:54:19.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 945dfe47-baea-4f9f-8bcd-7cc877014446 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101312025-08-12T22:54:20.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 60a1b92e-4f5e-4b83-8a77-5f85fec43721 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101322025-08-12T22:54:20.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 60a1b92e-4f5e-4b83-8a77-5f85fec43721 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101332025-08-12T22:54:20.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 60a1b92e-4f5e-4b83-8a77-5f85fec43721 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
101342025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
101352025-08-12T22:54:21.049ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0
101362025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
101372025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.45\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0"}
101382025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
101392025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
101402025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
101412025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101422025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101432025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
101442025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101452025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
101462025-08-12T22:54:21.049ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-12 22:44:21.049302133 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
101472025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
101482025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
101492025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
101502025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
101512025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
101522025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101532025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
101542025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
101552025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
101562025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101572025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
101582025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 12 reason = Timeout
101592025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
101602025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
101612025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
101622025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
101632025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
101642025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101652025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
101662025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
101672025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
101682025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101692025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
101702025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101712025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101722025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 16 reason = Timeout
101732025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
101742025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 10.5\u{b5}s iteration = 16 status = "Disabled"
101752025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
101762025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
101772025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 133 reason = Timeout
101782025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101792025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
101802025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101812025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
101822025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101832025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
101842025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
101852025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 23 reason = Timeout
101862025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 10.82\u{b5}s iteration = 23 status = {"disabled":true,"errors":[],"sps":[]}
101872025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
101882025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101892025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
101902025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101912025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101922025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
101932025-08-12T22:54:21.049ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
101942025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101952025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
101962025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101972025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101982025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 12 reason = Timeout
101992025-08-12T22:54:21.049ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
102002025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
102012025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102022025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
102032025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
102042025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102052025-08-12T22:54:21.050ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
102062025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
102072025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
102082025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
102092025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
102102025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102112025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102122025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
102132025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
102142025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
102152025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102162025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
102172025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
102182025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102192025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102202025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102212025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
102222025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102232025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102242025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
102252025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
102262025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
102272025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102282025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102292025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
102302025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102312025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102322025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102332025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102342025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
102352025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
102362025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102372025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
102382025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
102392025-08-12T22:54:21.050ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("043b8097-0e38-4228-bada-dac70e518148.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26cd5275-57f5-4466-a94f-f96956f55588.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1663, tv_nsec: 282657114 } })
102402025-08-12T22:54:21.050ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3e3264d-303d-4ce7-a0ce-0090b10b154f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1663, tv_nsec: 282654105 } })
102412025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102422025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102432025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102442025-08-12T22:54:21.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102452025-08-12T22:54:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102462025-08-12T22:54:21.051ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
102472025-08-12T22:54:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.04736ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
102482025-08-12T22:54:21.051ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
102492025-08-12T22:54:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.08892ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
102502025-08-12T22:54:21.052ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102512025-08-12T22:54:21.052ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1663, tv_nsec: 284843496 } })
102522025-08-12T22:54:21.052ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1663, tv_nsec: 284845816 } })
102532025-08-12T22:54:21.053ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
102542025-08-12T22:54:21.053ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-12 22:44:21.049302133 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
102552025-08-12T22:54:21.053ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
102562025-08-12T22:54:21.053ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.748547ms iteration = 12 status = {"expiration":"2025-08-12T22:44:21.049302133Z","pruned":[]}
102572025-08-12T22:54:21.053ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.587065ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
102582025-08-12T22:54:21.053ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102592025-08-12T22:54:21.053ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102602025-08-12T22:54:21.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102612025-08-12T22:54:21.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
102622025-08-12T22:54:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102632025-08-12T22:54:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102642025-08-12T22:54:21.054ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.049329ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
102652025-08-12T22:54:21.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102662025-08-12T22:54:21.054ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102672025-08-12T22:54:21.054ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
102682025-08-12T22:54:21.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102692025-08-12T22:54:21.054ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
102702025-08-12T22:54:21.054ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 5.193121ms iteration = 12 status = {"by_rx":{},"error":null}
102712025-08-12T22:54:21.055ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
102722025-08-12T22:54:21.055ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102732025-08-12T22:54:21.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102742025-08-12T22:54:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102752025-08-12T22:54:21.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
102762025-08-12T22:54:21.056ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102772025-08-12T22:54:21.058ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 8.790266ms iteration = 12 status = {"dispatched":[],"errors":[],"glob_version":"180.0.0","globs_reprocessed":{},"no_receivers":[]}
102782025-08-12T22:54:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102792025-08-12T22:54:21.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102802025-08-12T22:54:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102812025-08-12T22:54:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102822025-08-12T22:54:21.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102832025-08-12T22:54:21.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.020357ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
102842025-08-12T22:54:21.065ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
102852025-08-12T22:54:21.065ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
102862025-08-12T22:54:21.065ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
102872025-08-12T22:54:21.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102882025-08-12T22:54:21.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102892025-08-12T22:54:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102902025-08-12T22:54:21.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102912025-08-12T22:54:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102922025-08-12T22:54:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102932025-08-12T22:54:21.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102942025-08-12T22:54:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102952025-08-12T22:54:21.067ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102962025-08-12T22:54:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102972025-08-12T22:54:21.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102982025-08-12T22:54:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102992025-08-12T22:54:21.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103002025-08-12T22:54:21.069ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 19.866234ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103012025-08-12T22:54:21.070ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103022025-08-12T22:54:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103032025-08-12T22:54:21.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103042025-08-12T22:54:21.071ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103052025-08-12T22:54:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103062025-08-12T22:54:21.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103072025-08-12T22:54:21.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
103082025-08-12T22:54:21.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103092025-08-12T22:54:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103102025-08-12T22:54:21.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103112025-08-12T22:54:21.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
103122025-08-12T22:54:21.075ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103132025-08-12T22:54:21.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103142025-08-12T22:54:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
103152025-08-12T22:54:21.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103162025-08-12T22:54:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103172025-08-12T22:54:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
103182025-08-12T22:54:21.077ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103192025-08-12T22:54:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103202025-08-12T22:54:21.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103212025-08-12T22:54:21.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3d7dc4a2-9529-4929-b791-4ed3b9fad234 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
103222025-08-12T22:54:21.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3d7dc4a2-9529-4929-b791-4ed3b9fad234 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
103232025-08-12T22:54:21.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
103242025-08-12T22:54:21.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103252025-08-12T22:54:21.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103262025-08-12T22:54:21.113ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103272025-08-12T22:54:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
103282025-08-12T22:54:21.115ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
103292025-08-12T22:54:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
103302025-08-12T22:54:21.126ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103312025-08-12T22:54:21.126ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103322025-08-12T22:54:21.128ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103332025-08-12T22:54:21.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103342025-08-12T22:54:21.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 25679 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3d7dc4a2-9529-4929-b791-4ed3b9fad234 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
103352025-08-12T22:54:21.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103362025-08-12T22:54:21.130ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103372025-08-12T22:54:21.130ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
103382025-08-12T22:54:21.130ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103392025-08-12T22:54:21.130ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1663, tv_nsec: 362444607 } })
103402025-08-12T22:54:21.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103412025-08-12T22:54:21.130ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
103422025-08-12T22:54:21.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
103432025-08-12T22:54:21.130ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
103442025-08-12T22:54:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
103452025-08-12T22:54:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
103462025-08-12T22:54:21.131ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103472025-08-12T22:54:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103482025-08-12T22:54:21.132ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103492025-08-12T22:54:21.132ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 82.924414ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
103502025-08-12T22:54:21.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 83.029694ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
103512025-08-12T22:54:21.132ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103522025-08-12T22:54:21.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103532025-08-12T22:54:21.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103542025-08-12T22:54:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103552025-08-12T22:54:21.133ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
103562025-08-12T22:54:21.133ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
103572025-08-12T22:54:21.133ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
103582025-08-12T22:54:21.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103592025-08-12T22:54:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103602025-08-12T22:54:21.133ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103612025-08-12T22:54:21.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103622025-08-12T22:54:21.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103632025-08-12T22:54:21.134ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
103642025-08-12T22:54:21.134ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
103652025-08-12T22:54:21.134ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103662025-08-12T22:54:21.134ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 84.963693ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
103672025-08-12T22:54:21.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103682025-08-12T22:54:21.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 85.228276ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103692025-08-12T22:54:21.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103702025-08-12T22:54:21.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
103712025-08-12T22:54:21.137ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
103722025-08-12T22:54:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
103732025-08-12T22:54:21.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 88.599819ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
103742025-08-12T22:54:21.138ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103752025-08-12T22:54:21.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103762025-08-12T22:54:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103772025-08-12T22:54:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
103782025-08-12T22:54:21.139ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
103792025-08-12T22:54:21.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
103802025-08-12T22:54:21.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
103812025-08-12T22:54:21.140ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103822025-08-12T22:54:21.140ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
103832025-08-12T22:54:21.140ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 90.888702ms iteration = 133 status = {"chicken_switches_updated":false}
103842025-08-12T22:54:21.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103852025-08-12T22:54:21.141ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
103862025-08-12T22:54:21.141ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
103872025-08-12T22:54:21.141ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103882025-08-12T22:54:21.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103892025-08-12T22:54:21.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103902025-08-12T22:54:21.144ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
103912025-08-12T22:54:21.144ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.718199ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
103922025-08-12T22:54:21.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
103932025-08-12T22:54:21.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103942025-08-12T22:54:21.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103952025-08-12T22:54:21.149ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
103962025-08-12T22:54:21.149ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
103972025-08-12T22:54:21.149ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-12 22:43:49.909589 UTC dns_group = internal generation = 1
103982025-08-12T22:54:21.149ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 100.460746ms iteration = 12 status = {"generation":1}
103992025-08-12T22:54:21.155ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 106.06658ms iteration = 26 status = {"physical_disks_added":0}
104002025-08-12T22:54:21.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 124.202378ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
104012025-08-12T22:54:21.175ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
104022025-08-12T22:54:21.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
104032025-08-12T22:54:21.177ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104042025-08-12T22:54:21.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
104052025-08-12T22:54:21.183ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
104062025-08-12T22:54:21.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
104072025-08-12T22:54:21.185ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104082025-08-12T22:54:21.185ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104092025-08-12T22:54:21.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104102025-08-12T22:54:21.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104112025-08-12T22:54:21.186ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
104122025-08-12T22:54:21.186ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 136.716731ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
104132025-08-12T22:54:21.187ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104142025-08-12T22:54:21.188ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104152025-08-12T22:54:21.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104162025-08-12T22:54:21.190ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104172025-08-12T22:54:21.190ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104182025-08-12T22:54:21.190ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
104192025-08-12T22:54:21.190ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.044043ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
104202025-08-12T22:54:21.191ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
104212025-08-12T22:54:21.191ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104222025-08-12T22:54:21.191ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
104232025-08-12T22:54:21.191ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104242025-08-12T22:54:21.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104252025-08-12T22:54:21.192ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76e86040-69b0-4a4b-810d-f96767877223", "content-length": "26", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} })
104262025-08-12T22:54:21.192ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
104272025-08-12T22:54:21.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
104282025-08-12T22:54:21.193ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104292025-08-12T22:54:21.193ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
104302025-08-12T22:54:21.193ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 143.886642ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
104312025-08-12T22:54:21.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104322025-08-12T22:54:21.193ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
104332025-08-12T22:54:21.194ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
104342025-08-12T22:54:21.194ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
104352025-08-12T22:54:21.194ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 144.258824ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
104362025-08-12T22:54:21.195ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 145.8156ms iteration = 23 status = 0
104372025-08-12T22:54:21.198ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
104382025-08-12T22:54:21.198ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 0 version = 2
104392025-08-12T22:54:21.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104402025-08-12T22:54:21.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104412025-08-12T22:54:21.200ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104422025-08-12T22:54:21.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
104432025-08-12T22:54:21.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104442025-08-12T22:54:21.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104452025-08-12T22:54:21.204ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
104462025-08-12T22:54:21.205ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 4 version = 2
104472025-08-12T22:54:21.205ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
104482025-08-12T22:54:21.205ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-12 22:43:50.527483 UTC dns_group = external generation = 2
104492025-08-12T22:54:21.205ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 156.402223ms iteration = 12 status = {"generation":2}
104502025-08-12T22:54:21.240ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
104512025-08-12T22:54:21.240ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 191.438778ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
104522025-08-12T22:54:21.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104532025-08-12T22:54:21.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104542025-08-12T22:54:21.243ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-12T22:43:09.981233Z, time_modified: 2025-08-12T22:43:09.981233Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }) }
104552025-08-12T22:54:21.243ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 194.372196ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]}},"default_endpoint":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
104562025-08-12T22:54:21.251ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104572025-08-12T22:54:21.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104582025-08-12T22:54:21.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104592025-08-12T22:54:21.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104602025-08-12T22:54:21.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104612025-08-12T22:54:21.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104622025-08-12T22:54:21.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104632025-08-12T22:54:21.258ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104642025-08-12T22:54:21.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104652025-08-12T22:54:21.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104662025-08-12T22:54:21.305ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
104672025-08-12T22:54:21.305ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104682025-08-12T22:54:21.305ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bacff958-90ef-4fec-ab6a-43e701034e59", "content-length": "26", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} })
104692025-08-12T22:54:21.305ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
104702025-08-12T22:54:21.308ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
104712025-08-12T22:54:21.310ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
104722025-08-12T22:54:21.362ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 312.846398ms iteration = 23 status = {}
104732025-08-12T22:54:21.425ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
104742025-08-12T22:54:21.425ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e7357a4d-e57b-4c45-b6c7-1a36691d3231", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
104752025-08-12T22:54:21.425ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
104762025-08-12T22:54:21.428ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "33449bd1-428e-4a5d-a5b5-9b1fc004cc7f", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
104772025-08-12T22:54:21.428ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
104782025-08-12T22:54:21.432ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
104792025-08-12T22:54:21.432ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 382.840325ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
104802025-08-12T22:54:21.461ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
104812025-08-12T22:54:21.461ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
104822025-08-12T22:54:21.462ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
104832025-08-12T22:54:21.462ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104842025-08-12T22:54:21.462ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0daa4e9d-c4e4-497b-a482-92549c9c708f", "content-length": "372", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} })
104852025-08-12T22:54:21.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104862025-08-12T22:54:21.462ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d1aa617-be45-4d10-9ebf-c8c867d50d07", "content-length": "26", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} })
104872025-08-12T22:54:21.462ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
104882025-08-12T22:54:21.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104892025-08-12T22:54:21.465ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
104902025-08-12T22:54:21.466ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
104912025-08-12T22:54:21.467ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "654d552f-e0c2-400c-9754-3775a3e850f9", "content-length": "691", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} })
104922025-08-12T22:54:21.467ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
104932025-08-12T22:54:21.467ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
104942025-08-12T22:54:21.467ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
104952025-08-12T22:54:21.468ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 419.209091ms iteration = 23 status = {}
104962025-08-12T22:54:21.478ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
104972025-08-12T22:54:21.478ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
104982025-08-12T22:54:21.478ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "843db172-61a4-4f66-a466-08715519e7ba", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} })
104992025-08-12T22:54:21.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105002025-08-12T22:54:21.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105012025-08-12T22:54:21.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105022025-08-12T22:54:21.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105032025-08-12T22:54:21.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105042025-08-12T22:54:21.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105052025-08-12T22:54:21.490ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
105062025-08-12T22:54:21.490ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
105072025-08-12T22:54:21.490ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5fcdc96e-0d23-48a1-8353-7e7d4198dd14", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} })
105082025-08-12T22:54:21.492ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 442.961084ms iteration = 23 status = {}
105092025-08-12T22:54:21.516ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105102025-08-12T22:54:21.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105112025-08-12T22:54:21.517ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
105122025-08-12T22:54:21.519ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 470.391123ms iteration = 23 status = null
105132025-08-12T22:54:21.584ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
105142025-08-12T22:54:21.584ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "de7a7645-97c6-4404-8a7f-333aa600c1ea", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
105152025-08-12T22:54:21.585ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
105162025-08-12T22:54:21.587ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9536eda8-467c-411b-92e3-c0ad61e1f677", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
105172025-08-12T22:54:21.587ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
105182025-08-12T22:54:21.589ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e7a0e7c5-7f6b-4709-8766-90e1bdee2af1", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
105192025-08-12T22:54:21.589ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
105202025-08-12T22:54:21.591ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
105212025-08-12T22:54:21.591ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 542.377819ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
105222025-08-12T22:54:21.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105232025-08-12T22:54:21.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105242025-08-12T22:54:21.626ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
105252025-08-12T22:54:21.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105262025-08-12T22:54:21.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105272025-08-12T22:54:21.638ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
105282025-08-12T22:54:21.638ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
105292025-08-12T22:54:21.638ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
105302025-08-12T22:54:21.639ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
105312025-08-12T22:54:21.639ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105322025-08-12T22:54:21.639ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105332025-08-12T22:54:21.639ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105342025-08-12T22:54:21.639ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
105352025-08-12T22:54:21.639ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105362025-08-12T22:54:21.639ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
105372025-08-12T22:54:21.639ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
105382025-08-12T22:54:21.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105392025-08-12T22:54:21.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105402025-08-12T22:54:21.642ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
105412025-08-12T22:54:21.642ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
105422025-08-12T22:54:21.752ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9cdb76aa-3be9-4262-b209-62126dad6e31", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} })
105432025-08-12T22:54:21.752ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
105442025-08-12T22:54:21.752ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
105452025-08-12T22:54:21.753ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "971fc675-b61f-4981-af78-39ede2a4dbb5", "content-length": "682", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} })
105462025-08-12T22:54:21.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105472025-08-12T22:54:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105482025-08-12T22:54:21.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105492025-08-12T22:54:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105502025-08-12T22:54:21.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105512025-08-12T22:54:21.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105522025-08-12T22:54:21.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105532025-08-12T22:54:21.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105542025-08-12T22:54:21.771ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 721.806159ms iteration = 23 status = {}
105552025-08-12T22:54:21.906ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 4
105562025-08-12T22:54:21.906ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221
105572025-08-12T22:54:21.937ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
105582025-08-12T22:54:21.937ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:47275
105592025-08-12T22:54:21.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47275 req_id = ddfef27c-12f7-4710-9885-4000df5fcb03 roles = RoleSet { roles: {} } uri = /metrics/producers
105602025-08-12T22:54:21.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47275 req_id = ddfef27c-12f7-4710-9885-4000df5fcb03 resource = Database result = Ok(()) uri = /metrics/producers
105612025-08-12T22:54:21.993ZINFOnexus: assigned collector to new producer collector_id = 4c467f25-cb67-42ad-b276-c490b467a350 file = nexus/src/app/oximeter.rs:76 producer_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
105622025-08-12T22:54:21.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 55633 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47275 req_id = ddfef27c-12f7-4710-9885-4000df5fcb03 response_code = 201 uri = /metrics/producers
105632025-08-12T22:54:21.993ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "ddfef27c-12f7-4710-9885-4000df5fcb03", "content-length": "41", "date": "Tue, 12 Aug 2025 22:54:21 GMT"} })
105642025-08-12T22:54:21.995ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
105652025-08-12T22:54:22.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ca47e438-855d-4d6a-90c4-62ca32eb4315 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105662025-08-12T22:54:22.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ca47e438-855d-4d6a-90c4-62ca32eb4315 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105672025-08-12T22:54:22.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ca47e438-855d-4d6a-90c4-62ca32eb4315 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105682025-08-12T22:54:23.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d43cb5b-6626-43c4-9c0d-b7882677e002 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105692025-08-12T22:54:23.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d43cb5b-6626-43c4-9c0d-b7882677e002 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105702025-08-12T22:54:23.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6d43cb5b-6626-43c4-9c0d-b7882677e002 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105712025-08-12T22:54:24.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 374cfdb2-4609-4b5a-8fc9-e87c20762a1c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105722025-08-12T22:54:24.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 374cfdb2-4609-4b5a-8fc9-e87c20762a1c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105732025-08-12T22:54:24.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 374cfdb2-4609-4b5a-8fc9-e87c20762a1c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105742025-08-12T22:54:25.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a6eea73a-b002-42b0-aed5-a702a7964622 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105752025-08-12T22:54:25.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a6eea73a-b002-42b0-aed5-a702a7964622 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105762025-08-12T22:54:25.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a6eea73a-b002-42b0-aed5-a702a7964622 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105772025-08-12T22:54:26.049ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 134 reason = Timeout
105782025-08-12T22:54:26.049ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
105792025-08-12T22:54:26.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
105802025-08-12T22:54:26.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105812025-08-12T22:54:26.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
105822025-08-12T22:54:26.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
105832025-08-12T22:54:26.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
105842025-08-12T22:54:26.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
105852025-08-12T22:54:26.056ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.993799ms iteration = 134 status = {"chicken_switches_updated":false}
105862025-08-12T22:54:26.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eb8e4d71-97b6-4a32-8e86-27f776aca517 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105872025-08-12T22:54:26.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eb8e4d71-97b6-4a32-8e86-27f776aca517 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105882025-08-12T22:54:26.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eb8e4d71-97b6-4a32-8e86-27f776aca517 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105892025-08-12T22:54:27.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2b9c60f1-4944-4398-be50-385eacd7d93f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105902025-08-12T22:54:27.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2b9c60f1-4944-4398-be50-385eacd7d93f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105912025-08-12T22:54:27.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2b9c60f1-4944-4398-be50-385eacd7d93f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105922025-08-12T22:54:28.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ad23be54-d5e5-42d2-8e30-e7a14de1ed05 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105932025-08-12T22:54:28.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ad23be54-d5e5-42d2-8e30-e7a14de1ed05 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105942025-08-12T22:54:28.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ad23be54-d5e5-42d2-8e30-e7a14de1ed05 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105952025-08-12T22:54:28.837ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 491 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 598cd13d-c73a-4e69-9781-c80e17e119e1 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
105962025-08-12T22:54:29.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1f53f676-46c0-4076-9fd1-f06863f5e164 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105972025-08-12T22:54:29.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1f53f676-46c0-4076-9fd1-f06863f5e164 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105982025-08-12T22:54:29.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1f53f676-46c0-4076-9fd1-f06863f5e164 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
105992025-08-12T22:54:30.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6c77160c-b221-420c-9b00-c99e5d77f06b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106002025-08-12T22:54:30.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6c77160c-b221-420c-9b00-c99e5d77f06b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106012025-08-12T22:54:30.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6c77160c-b221-420c-9b00-c99e5d77f06b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106022025-08-12T22:54:31.050ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
106032025-08-12T22:54:31.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106042025-08-12T22:54:31.050ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
106052025-08-12T22:54:31.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106062025-08-12T22:54:31.050ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 135 reason = Timeout
106072025-08-12T22:54:31.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
106082025-08-12T22:54:31.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106092025-08-12T22:54:31.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
106102025-08-12T22:54:31.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106112025-08-12T22:54:31.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106122025-08-12T22:54:31.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106132025-08-12T22:54:31.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106142025-08-12T22:54:31.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106152025-08-12T22:54:31.054ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.354993ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106162025-08-12T22:54:31.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106172025-08-12T22:54:31.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106182025-08-12T22:54:31.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106192025-08-12T22:54:31.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
106202025-08-12T22:54:31.056ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
106212025-08-12T22:54:31.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
106222025-08-12T22:54:31.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106232025-08-12T22:54:31.058ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
106242025-08-12T22:54:31.058ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.029879ms iteration = 135 status = {"chicken_switches_updated":false}
106252025-08-12T22:54:31.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106262025-08-12T22:54:31.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106272025-08-12T22:54:31.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
106282025-08-12T22:54:31.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106292025-08-12T22:54:31.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106302025-08-12T22:54:31.074ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
106312025-08-12T22:54:31.074ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.043406ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
106322025-08-12T22:54:31.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4e96c5a6-ce64-4f9d-9dc2-15f1088226c1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106332025-08-12T22:54:31.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4e96c5a6-ce64-4f9d-9dc2-15f1088226c1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106342025-08-12T22:54:31.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4e96c5a6-ce64-4f9d-9dc2-15f1088226c1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106352025-08-12T22:54:32.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = caec1bc7-fc66-4fcf-b50c-cbe66545d9dc roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106362025-08-12T22:54:32.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = caec1bc7-fc66-4fcf-b50c-cbe66545d9dc resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106372025-08-12T22:54:32.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = caec1bc7-fc66-4fcf-b50c-cbe66545d9dc response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106382025-08-12T22:54:33.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = def07123-396a-4b94-ae55-e1b110e0bfc8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106392025-08-12T22:54:33.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = def07123-396a-4b94-ae55-e1b110e0bfc8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106402025-08-12T22:54:33.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = def07123-396a-4b94-ae55-e1b110e0bfc8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106412025-08-12T22:54:34.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c761b7ea-fe49-46a8-bbc5-6995cb102028 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106422025-08-12T22:54:34.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c761b7ea-fe49-46a8-bbc5-6995cb102028 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106432025-08-12T22:54:34.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c761b7ea-fe49-46a8-bbc5-6995cb102028 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106442025-08-12T22:54:35.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5da1fa9f-e66b-48a5-9734-fa154c9779c6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106452025-08-12T22:54:35.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5da1fa9f-e66b-48a5-9734-fa154c9779c6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106462025-08-12T22:54:35.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5da1fa9f-e66b-48a5-9734-fa154c9779c6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106472025-08-12T22:54:36.050ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 136 reason = Timeout
106482025-08-12T22:54:36.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
106492025-08-12T22:54:36.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
106502025-08-12T22:54:36.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106512025-08-12T22:54:36.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
106522025-08-12T22:54:36.055ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
106532025-08-12T22:54:36.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
106542025-08-12T22:54:36.056ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
106552025-08-12T22:54:36.056ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.467294ms iteration = 136 status = {"chicken_switches_updated":false}
106562025-08-12T22:54:36.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 952a49f9-77ee-437d-93a6-e673f6d1e5fb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106572025-08-12T22:54:36.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 952a49f9-77ee-437d-93a6-e673f6d1e5fb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106582025-08-12T22:54:36.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 952a49f9-77ee-437d-93a6-e673f6d1e5fb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106592025-08-12T22:54:37.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 35b1b818-1239-484c-9ebe-05701f6aa69d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106602025-08-12T22:54:37.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 35b1b818-1239-484c-9ebe-05701f6aa69d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106612025-08-12T22:54:37.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 35b1b818-1239-484c-9ebe-05701f6aa69d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106622025-08-12T22:54:38.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 99028b53-a01a-46fa-a5cc-e072d1af9710 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106632025-08-12T22:54:38.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 99028b53-a01a-46fa-a5cc-e072d1af9710 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106642025-08-12T22:54:38.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 99028b53-a01a-46fa-a5cc-e072d1af9710 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106652025-08-12T22:54:38.838ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 548 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = b642abcd-9119-42c2-9410-b4030a468320 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
106662025-08-12T22:54:39.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be8acacf-0f6e-41be-843f-3f0e9b3073aa roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106672025-08-12T22:54:39.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be8acacf-0f6e-41be-843f-3f0e9b3073aa resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106682025-08-12T22:54:39.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1827 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = be8acacf-0f6e-41be-843f-3f0e9b3073aa response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106692025-08-12T22:54:40.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8b4f6bfd-3ddd-4fe2-871e-9b7cd9a5538f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106702025-08-12T22:54:40.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8b4f6bfd-3ddd-4fe2-871e-9b7cd9a5538f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106712025-08-12T22:54:40.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8b4f6bfd-3ddd-4fe2-871e-9b7cd9a5538f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
106722025-08-12T22:54:41.050ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
106732025-08-12T22:54:41.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106742025-08-12T22:54:41.050ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
106752025-08-12T22:54:41.050ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 137 reason = Timeout
106762025-08-12T22:54:41.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106772025-08-12T22:54:41.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
106782025-08-12T22:54:41.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106792025-08-12T22:54:41.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106802025-08-12T22:54:41.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
106812025-08-12T22:54:41.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106822025-08-12T22:54:41.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106832025-08-12T22:54:41.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106842025-08-12T22:54:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106852025-08-12T22:54:41.054ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.623305ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106862025-08-12T22:54:41.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106872025-08-12T22:54:41.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106882025-08-12T22:54:41.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106892025-08-12T22:54:41.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
106902025-08-12T22:54:41.056ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
106912025-08-12T22:54:41.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
106922025-08-12T22:54:41.058ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
106932025-08-12T22:54:41.058ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.753665ms iteration = 137 status = {"chicken_switches_updated":false}
106942025-08-12T22:54:41.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106952025-08-12T22:54:41.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106962025-08-12T22:54:41.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106972025-08-12T22:54:41.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
106982025-08-12T22:54:41.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106992025-08-12T22:54:41.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107002025-08-12T22:54:41.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
107012025-08-12T22:54:41.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.592331ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
107022025-08-12T22:54:41.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 02ebec2e-8606-4cba-91df-d3e37652b637 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107032025-08-12T22:54:41.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 02ebec2e-8606-4cba-91df-d3e37652b637 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107042025-08-12T22:54:41.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 02ebec2e-8606-4cba-91df-d3e37652b637 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107052025-08-12T22:54:42.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a8089d59-0330-4be6-87a5-407939ac0f39 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107062025-08-12T22:54:42.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a8089d59-0330-4be6-87a5-407939ac0f39 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107072025-08-12T22:54:42.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a8089d59-0330-4be6-87a5-407939ac0f39 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107082025-08-12T22:54:43.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5912d3e0-9a15-4e89-8d61-548d815435ad roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107092025-08-12T22:54:43.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5912d3e0-9a15-4e89-8d61-548d815435ad resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107102025-08-12T22:54:43.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5912d3e0-9a15-4e89-8d61-548d815435ad response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107112025-08-12T22:54:43.824ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:57209
107122025-08-12T22:54:43.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 15247e53-2e91-4a7a-88c4-419a2e75a1ab roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
107132025-08-12T22:54:43.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 15247e53-2e91-4a7a-88c4-419a2e75a1ab resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
107142025-08-12T22:54:43.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 15247e53-2e91-4a7a-88c4-419a2e75a1ab response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
107152025-08-12T22:54:43.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 7c07bd4f-55a2-40ed-b821-e8a1b6c2877f roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
107162025-08-12T22:54:43.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 7c07bd4f-55a2-40ed-b821-e8a1b6c2877f resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
107172025-08-12T22:54:43.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 7c07bd4f-55a2-40ed-b821-e8a1b6c2877f response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
107182025-08-12T22:54:44.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dd29f57d-63de-41a7-9594-fc17c01843bb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107192025-08-12T22:54:44.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dd29f57d-63de-41a7-9594-fc17c01843bb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107202025-08-12T22:54:44.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dd29f57d-63de-41a7-9594-fc17c01843bb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107212025-08-12T22:54:45.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5ecc8528-673c-4d85-972c-a981f2a2bacb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107222025-08-12T22:54:45.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5ecc8528-673c-4d85-972c-a981f2a2bacb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107232025-08-12T22:54:45.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5ecc8528-673c-4d85-972c-a981f2a2bacb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107242025-08-12T22:54:46.050ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 138 reason = Timeout
107252025-08-12T22:54:46.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
107262025-08-12T22:54:46.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
107272025-08-12T22:54:46.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107282025-08-12T22:54:46.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
107292025-08-12T22:54:46.055ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
107302025-08-12T22:54:46.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
107312025-08-12T22:54:46.057ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
107322025-08-12T22:54:46.057ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.521574ms iteration = 138 status = {"chicken_switches_updated":false}
107332025-08-12T22:54:46.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f7d50426-0077-4dfe-ac58-4a4ae95be1c4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107342025-08-12T22:54:46.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f7d50426-0077-4dfe-ac58-4a4ae95be1c4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107352025-08-12T22:54:46.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f7d50426-0077-4dfe-ac58-4a4ae95be1c4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107362025-08-12T22:54:47.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = db0828d4-dd56-4881-8673-d161c983f5b1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107372025-08-12T22:54:47.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = db0828d4-dd56-4881-8673-d161c983f5b1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107382025-08-12T22:54:47.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = db0828d4-dd56-4881-8673-d161c983f5b1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107392025-08-12T22:54:48.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ef3f8641-7a1e-49eb-9429-fe89d18fac7c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107402025-08-12T22:54:48.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ef3f8641-7a1e-49eb-9429-fe89d18fac7c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107412025-08-12T22:54:48.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ef3f8641-7a1e-49eb-9429-fe89d18fac7c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107422025-08-12T22:54:48.838ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 523 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 0837deaf-1888-430d-b904-339f9b42611e response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
107432025-08-12T22:54:49.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c1814475-e461-4fa9-bf29-42cfce387924 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107442025-08-12T22:54:49.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c1814475-e461-4fa9-bf29-42cfce387924 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107452025-08-12T22:54:49.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c1814475-e461-4fa9-bf29-42cfce387924 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107462025-08-12T22:54:50.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9a298466-b413-4061-9f0f-48ef77e3d74d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107472025-08-12T22:54:50.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9a298466-b413-4061-9f0f-48ef77e3d74d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107482025-08-12T22:54:50.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9a298466-b413-4061-9f0f-48ef77e3d74d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
107492025-08-12T22:54:51.049ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
107502025-08-12T22:54:51.049ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
107512025-08-12T22:54:51.049ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
107522025-08-12T22:54:51.049ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
107532025-08-12T22:54:51.049ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
107542025-08-12T22:54:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
107552025-08-12T22:54:51.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
107562025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 24 reason = Timeout
107572025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
107582025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
107592025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107602025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 14.2\u{b5}s iteration = 24 status = {"disabled":true,"errors":[],"sps":[]}
107612025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
107622025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
107632025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
107642025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
107652025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107662025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107672025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
107682025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107692025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
107702025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
107712025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
107722025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107732025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
107742025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
107752025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
107762025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
107772025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
107782025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 139 reason = Timeout
107792025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107802025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
107812025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
107822025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107832025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
107842025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
107852025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
107862025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
107872025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
107882025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107892025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
107902025-08-12T22:54:51.051ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
107912025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
107922025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107932025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107942025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107952025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
107962025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107972025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107982025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
107992025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
108002025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108012025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108022025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
108032025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108042025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108052025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
108062025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108072025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
108082025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108092025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108102025-08-12T22:54:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108112025-08-12T22:54:51.053ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1693, tv_nsec: 284733312 } })
108122025-08-12T22:54:51.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.218111ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
108132025-08-12T22:54:51.053ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1693, tv_nsec: 284848303 } })
108142025-08-12T22:54:51.053ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
108152025-08-12T22:54:51.053ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
108162025-08-12T22:54:51.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108172025-08-12T22:54:51.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108182025-08-12T22:54:51.053ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108192025-08-12T22:54:51.053ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.01961ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
108202025-08-12T22:54:51.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108212025-08-12T22:54:51.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108222025-08-12T22:54:51.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108232025-08-12T22:54:51.054ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108242025-08-12T22:54:51.054ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
108252025-08-12T22:54:51.054ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108262025-08-12T22:54:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108272025-08-12T22:54:51.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
108282025-08-12T22:54:51.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
108292025-08-12T22:54:51.057ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.531084ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
108302025-08-12T22:54:51.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
108312025-08-12T22:54:51.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108322025-08-12T22:54:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
108332025-08-12T22:54:51.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108342025-08-12T22:54:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
108352025-08-12T22:54:51.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108362025-08-12T22:54:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108372025-08-12T22:54:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
108382025-08-12T22:54:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108392025-08-12T22:54:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
108402025-08-12T22:54:51.058ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
108412025-08-12T22:54:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
108422025-08-12T22:54:51.058ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108432025-08-12T22:54:51.058ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
108442025-08-12T22:54:51.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108452025-08-12T22:54:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108462025-08-12T22:54:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108472025-08-12T22:54:51.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108482025-08-12T22:54:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108492025-08-12T22:54:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
108502025-08-12T22:54:51.059ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
108512025-08-12T22:54:51.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108522025-08-12T22:54:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
108532025-08-12T22:54:51.060ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1693, tv_nsec: 292504648 } })
108542025-08-12T22:54:51.061ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
108552025-08-12T22:54:51.061ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
108562025-08-12T22:54:51.061ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 10.271671ms iteration = 139 status = {"chicken_switches_updated":false}
108572025-08-12T22:54:51.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108582025-08-12T22:54:51.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
108592025-08-12T22:54:51.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108602025-08-12T22:54:51.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108612025-08-12T22:54:51.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108622025-08-12T22:54:51.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108632025-08-12T22:54:51.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
108642025-08-12T22:54:51.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108652025-08-12T22:54:51.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108662025-08-12T22:54:51.096ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
108672025-08-12T22:54:51.096ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.142193ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
108682025-08-12T22:54:51.099ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108692025-08-12T22:54:51.103ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 52.768217ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
108702025-08-12T22:54:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
108712025-08-12T22:54:51.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108722025-08-12T22:54:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108732025-08-12T22:54:51.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108742025-08-12T22:54:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108752025-08-12T22:54:51.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108762025-08-12T22:54:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108772025-08-12T22:54:51.110ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.632354ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
108782025-08-12T22:54:51.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.787687ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
108792025-08-12T22:54:51.111ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108802025-08-12T22:54:51.111ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
108812025-08-12T22:54:51.111ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 60.893337ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
108822025-08-12T22:54:51.113ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
108832025-08-12T22:54:51.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
108842025-08-12T22:54:51.114ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108852025-08-12T22:54:51.115ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108862025-08-12T22:54:51.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108872025-08-12T22:54:51.117ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108882025-08-12T22:54:51.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
108892025-08-12T22:54:51.117ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
108902025-08-12T22:54:51.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
108912025-08-12T22:54:51.119ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108922025-08-12T22:54:51.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108932025-08-12T22:54:51.119ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108942025-08-12T22:54:51.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108952025-08-12T22:54:51.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108962025-08-12T22:54:51.120ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
108972025-08-12T22:54:51.120ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.113228ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
108982025-08-12T22:54:51.120ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108992025-08-12T22:54:51.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
109002025-08-12T22:54:51.121ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109012025-08-12T22:54:51.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109022025-08-12T22:54:51.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 71.38741ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
109032025-08-12T22:54:51.123ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109042025-08-12T22:54:51.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109052025-08-12T22:54:51.125ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109062025-08-12T22:54:51.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109072025-08-12T22:54:51.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109082025-08-12T22:54:51.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109092025-08-12T22:54:51.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 101.641927ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109102025-08-12T22:54:51.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109112025-08-12T22:54:51.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109122025-08-12T22:54:51.155ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
109132025-08-12T22:54:51.155ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 104.738928ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
109142025-08-12T22:54:51.156ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109152025-08-12T22:54:51.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
109162025-08-12T22:54:51.159ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109172025-08-12T22:54:51.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109182025-08-12T22:54:51.160ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
109192025-08-12T22:54:51.160ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109202025-08-12T22:54:51.160ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.728126ms iteration = 24 status = 0
109212025-08-12T22:54:51.161ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9a2f94b-f3a2-446c-87ad-9532e3979ba3", "content-length": "26", "date": "Tue, 12 Aug 2025 22:54:51 GMT"} })
109222025-08-12T22:54:51.161ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109232025-08-12T22:54:51.162ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109242025-08-12T22:54:51.163ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
109252025-08-12T22:54:51.163ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109262025-08-12T22:54:51.164ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4124ff01-f140-4622-afb1-49de847f2f0c", "content-length": "26", "date": "Tue, 12 Aug 2025 22:54:51 GMT"} })
109272025-08-12T22:54:51.164ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109282025-08-12T22:54:51.165ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109292025-08-12T22:54:51.184ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
109302025-08-12T22:54:51.184ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109312025-08-12T22:54:51.184ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b12db4b7-9f55-45d0-bda1-e78b0ca7e963", "content-length": "372", "date": "Tue, 12 Aug 2025 22:54:51 GMT"} })
109322025-08-12T22:54:51.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109332025-08-12T22:54:51.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109342025-08-12T22:54:51.187ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
109352025-08-12T22:54:51.187ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109362025-08-12T22:54:51.187ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6f519ff-0e4e-4ddb-a377-c45458d4ccbf", "content-length": "26", "date": "Tue, 12 Aug 2025 22:54:51 GMT"} })
109372025-08-12T22:54:51.187ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109382025-08-12T22:54:51.188ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
109392025-08-12T22:54:51.196ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109402025-08-12T22:54:51.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109412025-08-12T22:54:51.199ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
109422025-08-12T22:54:51.199ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
109432025-08-12T22:54:51.199ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d5da4a4b-bd29-4cd2-9454-221020f990f0", "date": "Tue, 12 Aug 2025 22:54:51 GMT"} })
109442025-08-12T22:54:51.199ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109452025-08-12T22:54:51.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109462025-08-12T22:54:51.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109472025-08-12T22:54:51.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109482025-08-12T22:54:51.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109492025-08-12T22:54:51.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109502025-08-12T22:54:51.209ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
109512025-08-12T22:54:51.209ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109522025-08-12T22:54:51.210ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "62734976-0193-4774-8054-f9296c2a7e53", "date": "Tue, 12 Aug 2025 22:54:51 GMT"} })
109532025-08-12T22:54:51.211ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 160.576425ms iteration = 24 status = {}
109542025-08-12T22:54:51.225ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109552025-08-12T22:54:51.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109562025-08-12T22:54:51.227ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 177.223438ms iteration = 24 status = null
109572025-08-12T22:54:51.229ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 179.212548ms iteration = 24 status = {}
109582025-08-12T22:54:51.240ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 189.61207ms iteration = 27 status = {"physical_disks_added":0}
109592025-08-12T22:54:51.295ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109602025-08-12T22:54:51.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109612025-08-12T22:54:51.298ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
109622025-08-12T22:54:51.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109632025-08-12T22:54:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109642025-08-12T22:54:51.312ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
109652025-08-12T22:54:51.312ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
109662025-08-12T22:54:51.312ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
109672025-08-12T22:54:51.312ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
109682025-08-12T22:54:51.312ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109692025-08-12T22:54:51.312ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109702025-08-12T22:54:51.312ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109712025-08-12T22:54:51.312ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109722025-08-12T22:54:51.312ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109732025-08-12T22:54:51.312ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109742025-08-12T22:54:51.313ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
109752025-08-12T22:54:51.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109762025-08-12T22:54:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109772025-08-12T22:54:51.315ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
109782025-08-12T22:54:51.315ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
109792025-08-12T22:54:51.319ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109802025-08-12T22:54:51.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109812025-08-12T22:54:51.321ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109822025-08-12T22:54:51.323ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109832025-08-12T22:54:51.323ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109842025-08-12T22:54:51.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109852025-08-12T22:54:51.325ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109862025-08-12T22:54:51.327ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109872025-08-12T22:54:51.327ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109882025-08-12T22:54:51.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109892025-08-12T22:54:51.360ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
109902025-08-12T22:54:51.367ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a632e166-9691-48d6-953d-0f3b88d0c34f", "content-length": "691", "date": "Tue, 12 Aug 2025 22:54:51 GMT"} })
109912025-08-12T22:54:51.367ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
109922025-08-12T22:54:51.367ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
109932025-08-12T22:54:51.367ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
109942025-08-12T22:54:51.371ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 320.024579ms iteration = 24 status = {}
109952025-08-12T22:54:51.452ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "75dc1ac0-ba12-4f04-b76b-dc56ca5dfc13", "date": "Tue, 12 Aug 2025 22:54:51 GMT"} })
109962025-08-12T22:54:51.452ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
109972025-08-12T22:54:51.452ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
109982025-08-12T22:54:51.453ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9a4f015-5391-4877-a2c5-da60ad1c4531", "content-length": "682", "date": "Tue, 12 Aug 2025 22:54:51 GMT"} })
109992025-08-12T22:54:51.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110002025-08-12T22:54:51.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110012025-08-12T22:54:51.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110022025-08-12T22:54:51.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110032025-08-12T22:54:51.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110042025-08-12T22:54:51.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110052025-08-12T22:54:51.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110062025-08-12T22:54:51.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110072025-08-12T22:54:51.468ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 417.872209ms iteration = 24 status = {}
110082025-08-12T22:54:51.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 92befb30-3228-4671-81ce-a81cb02c8709 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110092025-08-12T22:54:51.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 92befb30-3228-4671-81ce-a81cb02c8709 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110102025-08-12T22:54:51.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 92befb30-3228-4671-81ce-a81cb02c8709 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110112025-08-12T22:54:52.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fcf79de7-bf63-4a6e-92d0-3d6d00b8efe4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110122025-08-12T22:54:52.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fcf79de7-bf63-4a6e-92d0-3d6d00b8efe4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110132025-08-12T22:54:52.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = fcf79de7-bf63-4a6e-92d0-3d6d00b8efe4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110142025-08-12T22:54:53.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b5b2d0cc-2380-4a56-9fed-8a337e5deae6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110152025-08-12T22:54:53.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b5b2d0cc-2380-4a56-9fed-8a337e5deae6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110162025-08-12T22:54:53.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b5b2d0cc-2380-4a56-9fed-8a337e5deae6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110172025-08-12T22:54:54.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5e326832-8aab-4654-a52a-bc777eb0caa4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110182025-08-12T22:54:54.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5e326832-8aab-4654-a52a-bc777eb0caa4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110192025-08-12T22:54:54.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5e326832-8aab-4654-a52a-bc777eb0caa4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110202025-08-12T22:54:55.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 38a11f7d-98bb-48cc-afdd-bfc3a6d0704a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110212025-08-12T22:54:55.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 38a11f7d-98bb-48cc-afdd-bfc3a6d0704a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110222025-08-12T22:54:55.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 38a11f7d-98bb-48cc-afdd-bfc3a6d0704a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110232025-08-12T22:54:56.050ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 140 reason = Timeout
110242025-08-12T22:54:56.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
110252025-08-12T22:54:56.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
110262025-08-12T22:54:56.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110272025-08-12T22:54:56.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
110282025-08-12T22:54:56.057ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
110292025-08-12T22:54:56.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
110302025-08-12T22:54:56.060ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
110312025-08-12T22:54:56.060ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 9.943608ms iteration = 140 status = {"chicken_switches_updated":false}
110322025-08-12T22:54:56.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 93ba5420-7346-4351-9f10-21c728826735 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110332025-08-12T22:54:56.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 93ba5420-7346-4351-9f10-21c728826735 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110342025-08-12T22:54:56.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 93ba5420-7346-4351-9f10-21c728826735 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110352025-08-12T22:54:57.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 010b4154-652e-4b0e-a097-b7876231aeda roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110362025-08-12T22:54:57.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 010b4154-652e-4b0e-a097-b7876231aeda resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110372025-08-12T22:54:57.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 010b4154-652e-4b0e-a097-b7876231aeda response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110382025-08-12T22:54:58.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e63fcdd-cd1a-4650-b6b0-24f532f7df9d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110392025-08-12T22:54:58.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e63fcdd-cd1a-4650-b6b0-24f532f7df9d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110402025-08-12T22:54:58.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e63fcdd-cd1a-4650-b6b0-24f532f7df9d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110412025-08-12T22:54:58.838ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 622 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 4034d901-882e-446c-a413-0249b1ee5dfe response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
110422025-08-12T22:54:59.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8da7e2de-17fc-442d-95aa-05630a365494 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110432025-08-12T22:54:59.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8da7e2de-17fc-442d-95aa-05630a365494 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110442025-08-12T22:54:59.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8da7e2de-17fc-442d-95aa-05630a365494 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110452025-08-12T22:55:00.660ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 205fe3a0-d63e-463f-a1aa-498054034a41 remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 163e57e3-37ed-4015-b53d-a498bfc56538 uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-08-12T22:55:00.647748518Z }
110462025-08-12T22:55:00.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 163e57e3-37ed-4015-b53d-a498bfc56538 roles = RoleSet { roles: {} } uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
110472025-08-12T22:55:00.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 163e57e3-37ed-4015-b53d-a498bfc56538 resource = Database result = Ok(()) uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
110482025-08-12T22:55:00.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 39827 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 163e57e3-37ed-4015-b53d-a498bfc56538 response_code = 204 uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
110492025-08-12T22:55:00.722ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 205fe3a0-d63e-463f-a1aa-498054034a41 remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b96d0213-43eb-4f11-856e-625e543b8365 uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-08-12T22:55:00.722289058Z }
110502025-08-12T22:55:00.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b96d0213-43eb-4f11-856e-625e543b8365 roles = RoleSet { roles: {} } uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
110512025-08-12T22:55:00.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b96d0213-43eb-4f11-856e-625e543b8365 resource = Database result = Ok(()) uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
110522025-08-12T22:55:00.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 11147 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b96d0213-43eb-4f11-856e-625e543b8365 response_code = 204 uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
110532025-08-12T22:55:00.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1b63db87-aa24-422d-890d-a8d4cec2eb00 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110542025-08-12T22:55:00.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1b63db87-aa24-422d-890d-a8d4cec2eb00 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110552025-08-12T22:55:00.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1b63db87-aa24-422d-890d-a8d4cec2eb00 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110562025-08-12T22:55:01.050ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
110572025-08-12T22:55:01.050ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
110582025-08-12T22:55:01.050ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 141 reason = Timeout
110592025-08-12T22:55:01.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110602025-08-12T22:55:01.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110612025-08-12T22:55:01.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
110622025-08-12T22:55:01.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
110632025-08-12T22:55:01.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110642025-08-12T22:55:01.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110652025-08-12T22:55:01.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110662025-08-12T22:55:01.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110672025-08-12T22:55:01.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110682025-08-12T22:55:01.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110692025-08-12T22:55:01.054ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.987759ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110702025-08-12T22:55:01.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
110712025-08-12T22:55:01.055ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
110722025-08-12T22:55:01.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
110732025-08-12T22:55:01.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110742025-08-12T22:55:01.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110752025-08-12T22:55:01.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110762025-08-12T22:55:01.057ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
110772025-08-12T22:55:01.057ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.355492ms iteration = 141 status = {"chicken_switches_updated":false}
110782025-08-12T22:55:01.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110792025-08-12T22:55:01.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110802025-08-12T22:55:01.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110812025-08-12T22:55:01.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
110822025-08-12T22:55:01.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110832025-08-12T22:55:01.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110842025-08-12T22:55:01.080ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
110852025-08-12T22:55:01.080ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.119866ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
110862025-08-12T22:55:01.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = efc90892-aa20-40e1-a757-fae33f10f3b7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110872025-08-12T22:55:01.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = efc90892-aa20-40e1-a757-fae33f10f3b7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110882025-08-12T22:55:01.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = efc90892-aa20-40e1-a757-fae33f10f3b7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110892025-08-12T22:55:02.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 25b89baf-db1b-47de-9897-cfdc0392872e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110902025-08-12T22:55:02.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 25b89baf-db1b-47de-9897-cfdc0392872e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110912025-08-12T22:55:02.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 25b89baf-db1b-47de-9897-cfdc0392872e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110922025-08-12T22:55:03.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a766efb1-bbd2-4025-9181-1b9505512e8f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110932025-08-12T22:55:03.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a766efb1-bbd2-4025-9181-1b9505512e8f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110942025-08-12T22:55:03.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a766efb1-bbd2-4025-9181-1b9505512e8f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110952025-08-12T22:55:04.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b69a8c6d-9f6f-4d21-9f9c-9ecf40def2aa roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110962025-08-12T22:55:04.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b69a8c6d-9f6f-4d21-9f9c-9ecf40def2aa resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110972025-08-12T22:55:04.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b69a8c6d-9f6f-4d21-9f9c-9ecf40def2aa response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110982025-08-12T22:55:05.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cd309b9d-8801-48a9-9bc7-ae565164402c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
110992025-08-12T22:55:05.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cd309b9d-8801-48a9-9bc7-ae565164402c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111002025-08-12T22:55:05.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cd309b9d-8801-48a9-9bc7-ae565164402c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111012025-08-12T22:55:06.050ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 142 reason = Timeout
111022025-08-12T22:55:06.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
111032025-08-12T22:55:06.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
111042025-08-12T22:55:06.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111052025-08-12T22:55:06.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
111062025-08-12T22:55:06.055ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
111072025-08-12T22:55:06.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
111082025-08-12T22:55:06.057ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
111092025-08-12T22:55:06.057ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.799697ms iteration = 142 status = {"chicken_switches_updated":false}
111102025-08-12T22:55:06.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = df9ee7f2-9aaa-4a3d-a156-6da02a1e588e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111112025-08-12T22:55:06.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = df9ee7f2-9aaa-4a3d-a156-6da02a1e588e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111122025-08-12T22:55:06.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = df9ee7f2-9aaa-4a3d-a156-6da02a1e588e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111132025-08-12T22:55:07.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 75ffdb10-0eee-4b7a-802a-fb46cb673dfb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111142025-08-12T22:55:07.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 75ffdb10-0eee-4b7a-802a-fb46cb673dfb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111152025-08-12T22:55:07.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 75ffdb10-0eee-4b7a-802a-fb46cb673dfb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111162025-08-12T22:55:08.838ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 534 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 1eae9d42-bb03-4860-9a9f-a54fa32a8ac1 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
111172025-08-12T22:55:08.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6389c523-da9c-45ba-bc82-67e77103d7e8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111182025-08-12T22:55:08.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6389c523-da9c-45ba-bc82-67e77103d7e8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111192025-08-12T22:55:08.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 6389c523-da9c-45ba-bc82-67e77103d7e8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111202025-08-12T22:55:09.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e43a3f3-ab6a-40ca-ad45-a5b4d8c7ade4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111212025-08-12T22:55:09.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e43a3f3-ab6a-40ca-ad45-a5b4d8c7ade4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111222025-08-12T22:55:09.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e43a3f3-ab6a-40ca-ad45-a5b4d8c7ade4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111232025-08-12T22:55:10.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 75681c38-0a70-4d8c-b8ba-63128bbf95df roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111242025-08-12T22:55:10.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 75681c38-0a70-4d8c-b8ba-63128bbf95df resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111252025-08-12T22:55:10.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 75681c38-0a70-4d8c-b8ba-63128bbf95df response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111262025-08-12T22:55:11.050ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
111272025-08-12T22:55:11.051ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
111282025-08-12T22:55:11.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111292025-08-12T22:55:11.051ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 143 reason = Timeout
111302025-08-12T22:55:11.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111312025-08-12T22:55:11.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
111322025-08-12T22:55:11.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
111332025-08-12T22:55:11.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111342025-08-12T22:55:11.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111352025-08-12T22:55:11.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111362025-08-12T22:55:11.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111372025-08-12T22:55:11.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111382025-08-12T22:55:11.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111392025-08-12T22:55:11.054ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.728186ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111402025-08-12T22:55:11.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
111412025-08-12T22:55:11.056ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
111422025-08-12T22:55:11.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111432025-08-12T22:55:11.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111442025-08-12T22:55:11.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
111452025-08-12T22:55:11.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111462025-08-12T22:55:11.058ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
111472025-08-12T22:55:11.058ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.813927ms iteration = 143 status = {"chicken_switches_updated":false}
111482025-08-12T22:55:11.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111492025-08-12T22:55:11.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111502025-08-12T22:55:11.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111512025-08-12T22:55:11.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
111522025-08-12T22:55:11.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111532025-08-12T22:55:11.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111542025-08-12T22:55:11.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
111552025-08-12T22:55:11.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.272207ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
111562025-08-12T22:55:11.570ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 205fe3a0-d63e-463f-a1aa-498054034a41 remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3e3060ff-d0fb-4d68-b40e-694da2d9edb6 uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-08-12T22:55:11.570290767Z }
111572025-08-12T22:55:11.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3e3060ff-d0fb-4d68-b40e-694da2d9edb6 roles = RoleSet { roles: {} } uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111582025-08-12T22:55:11.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3e3060ff-d0fb-4d68-b40e-694da2d9edb6 resource = Database result = Ok(()) uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111592025-08-12T22:55:11.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 10495 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3e3060ff-d0fb-4d68-b40e-694da2d9edb6 response_code = 204 uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111602025-08-12T22:55:12.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cab1d6f9-9489-418b-9c45-5e7e6cd99aa6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111612025-08-12T22:55:12.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cab1d6f9-9489-418b-9c45-5e7e6cd99aa6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111622025-08-12T22:55:12.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cab1d6f9-9489-418b-9c45-5e7e6cd99aa6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111632025-08-12T22:55:13.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9c4b2ebc-7867-4e27-a93c-917f5b8afa9e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111642025-08-12T22:55:13.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9c4b2ebc-7867-4e27-a93c-917f5b8afa9e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111652025-08-12T22:55:13.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9c4b2ebc-7867-4e27-a93c-917f5b8afa9e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
111662025-08-12T22:55:13.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 2fe15389-8bdd-48f0-975b-745fc53a002d roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
111672025-08-12T22:55:13.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 2fe15389-8bdd-48f0-975b-745fc53a002d resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
111682025-08-12T22:55:13.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 2fe15389-8bdd-48f0-975b-745fc53a002d response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
111692025-08-12T22:55:13.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 04daf0a2-d995-407a-a9eb-8c9ebcf3711d roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
111702025-08-12T22:55:13.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 04daf0a2-d995-407a-a9eb-8c9ebcf3711d resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
111712025-08-12T22:55:13.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 04daf0a2-d995-407a-a9eb-8c9ebcf3711d response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
111722025-08-12T22:55:14.018ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 205fe3a0-d63e-463f-a1aa-498054034a41 remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-08-12T22:55:11.581211674Z }
111732025-08-12T22:55:14.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc roles = RoleSet { roles: {} } uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111742025-08-12T22:55:14.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc resource = Database result = Ok(()) uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111752025-08-12T22:55:14.028ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 205fe3a0-d63e-463f-a1aa-498054034a41 remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41 vmm_needs_update = true
111762025-08-12T22:55:14.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc roles = RoleSet { roles: {} } uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111772025-08-12T22:55:14.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc resource = Database result = Ok(()) uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111782025-08-12T22:55:14.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc roles = RoleSet { roles: {} } uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111792025-08-12T22:55:14.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc resource = Database result = Ok(()) uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111802025-08-12T22:55:14.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc roles = RoleSet { roles: {} } uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111812025-08-12T22:55:14.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc resource = Database result = Ok(()) uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111822025-08-12T22:55:14.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc roles = RoleSet { roles: {} } uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111832025-08-12T22:55:14.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc resource = Database result = Ok(()) uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111842025-08-12T22:55:14.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc roles = RoleSet { roles: {} } uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111852025-08-12T22:55:14.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc resource = Database result = Ok(()) uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111862025-08-12T22:55:14.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc roles = RoleSet { roles: {} } uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111872025-08-12T22:55:14.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc resource = Database result = Ok(()) uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111882025-08-12T22:55:14.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111892025-08-12T22:55:14.054ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, lookup_type: ById(4604c0f4-e471-4d75-8d0c-f1105f332e2d) }, key: 83149d44-98a1-4a7a-a772-c8f0adc88be9, lookup_type: ById(83149d44-98a1-4a7a-a772-c8f0adc88be9) }, key: 1da12625-f9ed-42ef-894f-fed0bef616fc, lookup_type: ById(1da12625-f9ed-42ef-894f-fed0bef616fc) } result = Ok(()) uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111902025-08-12T22:55:14.061ZINFOnexus (dropshot_internal): starting update saga for 1da12625-f9ed-42ef-894f-fed0bef616fc actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1603 instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-08-12T22:55:11.581211674Z }
111912025-08-12T22:55:14.062ZDEBGnexus (dropshot_internal): preparing instance-update saga for 1da12625-f9ed-42ef-894f-fed0bef616fc... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111922025-08-12T22:55:14.062ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:367 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update
111932025-08-12T22:55:14.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 43556 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 69a033d7-3a90-4a04-a49e-9054dea808bc response_code = 204 uri = /vmms/205fe3a0-d63e-463f-a1aa-498054034a41
111942025-08-12T22:55:14.067ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"1da12625-f9ed-42ef-894f-fed0bef616fc","lookup_type":{"ById":"1da12625-f9ed-42ef-894f-fed0bef616fc"},"parent":{"key":"83149d44-98a1-4a7a-a772-c8f0adc88be9","lookup_type":{"ById":"83149d44-98a1-4a7a-a772-c8f0adc88be9"},"parent":{"key":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","lookup_type":{"ById":"4604c0f4-e471-4d75-8d0c-f1105f332e2d"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
111952025-08-12T22:55:14.067ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update
111962025-08-12T22:55:14.121ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:467 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update
111972025-08-12T22:55:14.121ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
111982025-08-12T22:55:14.128ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
111992025-08-12T22:55:14.128ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564
112002025-08-12T22:55:14.146ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112012025-08-12T22:55:14.146ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564
112022025-08-12T22:55:14.150ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112032025-08-12T22:55:14.150ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564
112042025-08-12T22:55:14.158ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112052025-08-12T22:55:14.158ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("b6bd27fc-e8a8-484f-ae99-807e33f71af3")) node_id = 0 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564
112062025-08-12T22:55:14.161ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112072025-08-12T22:55:14.161ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564
112082025-08-12T22:55:14.183ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update
112092025-08-12T22:55:14.183ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112102025-08-12T22:55:14.183ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112112025-08-12T22:55:14.186ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112122025-08-12T22:55:14.186ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112132025-08-12T22:55:14.188ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112142025-08-12T22:55:14.188ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112152025-08-12T22:55:14.190ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112162025-08-12T22:55:14.190ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112172025-08-12T22:55:14.191ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112182025-08-12T22:55:14.192ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112192025-08-12T22:55:14.193ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112202025-08-12T22:55:14.194ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112212025-08-12T22:55:14.195ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112222025-08-12T22:55:14.199ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, lookup_type: ById(4604c0f4-e471-4d75-8d0c-f1105f332e2d) }, key: 83149d44-98a1-4a7a-a772-c8f0adc88be9, lookup_type: ById(83149d44-98a1-4a7a-a772-c8f0adc88be9) }, key: 1da12625-f9ed-42ef-894f-fed0bef616fc, lookup_type: ById(1da12625-f9ed-42ef-894f-fed0bef616fc) } result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112232025-08-12T22:55:14.199ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance updater_id = b6bd27fc-e8a8-484f-ae99-807e33f71af3
112242025-08-12T22:55:14.199ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112252025-08-12T22:55:14.199ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112262025-08-12T22:55:14.210ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance updater_id = b6bd27fc-e8a8-484f-ae99-807e33f71af3
112272025-08-12T22:55:14.210ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112282025-08-12T22:55:14.211ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance
112292025-08-12T22:55:14.217ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc locked_gen = Generation(Generation(2)) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = LockInstance updater_id = b6bd27fc-e8a8-484f-ae99-807e33f71af3
112302025-08-12T22:55:14.219ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112312025-08-12T22:55:14.219ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("b6bd27fc-e8a8-484f-ae99-807e33f71af3")}) node_id = 1 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564
112322025-08-12T22:55:14.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c7dedbdb-5fef-4b56-ad97-65dc34dbb2b0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
112332025-08-12T22:55:14.222ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112342025-08-12T22:55:14.222ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564
112352025-08-12T22:55:14.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c7dedbdb-5fef-4b56-ad97-65dc34dbb2b0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
112362025-08-12T22:55:14.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c7dedbdb-5fef-4b56-ad97-65dc34dbb2b0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
112372025-08-12T22:55:14.231ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
112382025-08-12T22:55:14.231ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
112392025-08-12T22:55:14.237ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
112402025-08-12T22:55:14.237ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
112412025-08-12T22:55:14.238ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
112422025-08-12T22:55:14.238ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
112432025-08-12T22:55:14.240ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
112442025-08-12T22:55:14.243ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, lookup_type: ById(4604c0f4-e471-4d75-8d0c-f1105f332e2d) }, key: 83149d44-98a1-4a7a-a772-c8f0adc88be9, lookup_type: ById(83149d44-98a1-4a7a-a772-c8f0adc88be9) }, key: 1da12625-f9ed-42ef-894f-fed0bef616fc, lookup_type: ById(1da12625-f9ed-42ef-894f-fed0bef616fc) } result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
112452025-08-12T22:55:14.243ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
112462025-08-12T22:55:14.244ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
112472025-08-12T22:55:14.252ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 205fe3a0-d63e-463f-a1aa-498054034a41, time_created: 2025-08-12T22:54:52.864090Z, time_deleted: None, instance_id: 1da12625-f9ed-42ef-894f-fed0bef616fc, sled_id: d04697ae-b4b1-419d-b9da-432e45c93990, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-08-12T22:55:11.581211Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-08-12T22:54:49.950274Z, gen: Generation(Generation(3)), propolis_id: Some(205fe3a0-d63e-463f-a1aa-498054034a41), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(205fe3a0-d63e-463f-a1aa-498054034a41 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-08-12T22:55:14.249905586Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
112482025-08-12T22:55:14.257ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:367 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
112492025-08-12T22:55:14.259ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"1da12625-f9ed-42ef-894f-fed0bef616fc","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"205fe3a0-d63e-463f-a1aa-498054034a41"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"1da12625-f9ed-42ef-894f-fed0bef616fc","lookup_type":{"ById":"1da12625-f9ed-42ef-894f-fed0bef616fc"},"parent":{"key":"83149d44-98a1-4a7a-a772-c8f0adc88be9","lookup_type":{"ById":"83149d44-98a1-4a7a-a772-c8f0adc88be9"},"parent":{"key":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","lookup_type":{"ById":"4604c0f4-e471-4d75-8d0c-f1105f332e2d"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"b6bd27fc-e8a8-484f-ae99-807e33f71af3"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"83149d44-98a1-4a7a-a772-c8f0adc88be9","ram_diff":1073741824},"destroy_active_vmm":"205fe3a0-d63e-463f-a1aa-498054034a41","destroy_target_vmm":null,"network_config":"Delete","new_intent":null,"new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-08-12T22:55:14.249905586Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112502025-08-12T22:55:14.259ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
112512025-08-12T22:55:14.299ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:467 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
112522025-08-12T22:55:14.299ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112532025-08-12T22:55:14.299ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112542025-08-12T22:55:14.299ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
112552025-08-12T22:55:14.303ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112562025-08-12T22:55:14.303ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
112572025-08-12T22:55:14.306ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112582025-08-12T22:55:14.306ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
112592025-08-12T22:55:14.309ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112602025-08-12T22:55:14.309ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("85ce7750-ade5-4f96-83ca-8e97b3d247ff")) node_id = 0 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
112612025-08-12T22:55:14.312ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112622025-08-12T22:55:14.312ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
112632025-08-12T22:55:14.320ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc parent_lock = UpdaterLock { updater_id: b6bd27fc-e8a8-484f-ae99-807e33f71af3, locked_gen: Generation(Generation(2)) } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
112642025-08-12T22:55:14.320ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = BecomeUpdater
112652025-08-12T22:55:14.320ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = BecomeUpdater
112662025-08-12T22:55:14.329ZDEBGnexus (SagaExecutor): inherited lock from b6bd27fc-e8a8-484f-ae99-807e33f71af3 to 85ce7750-ade5-4f96-83ca-8e97b3d247ff actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = b6bd27fc-e8a8-484f-ae99-807e33f71af3 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = BecomeUpdater updater_id = 85ce7750-ade5-4f96-83ca-8e97b3d247ff
112672025-08-12T22:55:14.329ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:987 instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
112682025-08-12T22:55:14.329ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112692025-08-12T22:55:14.329ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("85ce7750-ade5-4f96-83ca-8e97b3d247ff")}) node_id = 1 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
112702025-08-12T22:55:14.333ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112712025-08-12T22:55:14.333ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
112722025-08-12T22:55:14.343ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112732025-08-12T22:55:14.343ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
112742025-08-12T22:55:14.348ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
112752025-08-12T22:55:14.348ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
112762025-08-12T22:55:14.351ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1040 instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
112772025-08-12T22:55:14.353ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc
112782025-08-12T22:55:14.353ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = UpdateNetworkConfig
112792025-08-12T22:55:14.354ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = UpdateNetworkConfig
112802025-08-12T22:55:14.356ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = UpdateNetworkConfig
112812025-08-12T22:55:14.356ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = UpdateNetworkConfig
112822025-08-12T22:55:14.363ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
112832025-08-12T22:55:14.363ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = UpdateNetworkConfig
112842025-08-12T22:55:14.363ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = UpdateNetworkConfig
112852025-08-12T22:55:14.365ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
112862025-08-12T22:55:14.365ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
112872025-08-12T22:55:14.366ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
112882025-08-12T22:55:14.367ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
112892025-08-12T22:55:14.369ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
112902025-08-12T22:55:14.369ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
112912025-08-12T22:55:14.369ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
112922025-08-12T22:55:14.377ZDEBGnexus: notifying dendrite of updates instance_id = Some(1da12625-f9ed-42ef-894f-fed0bef616fc (instance)) switch = switch0
112932025-08-12T22:55:14.378ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1716, tv_nsec: 609475965 } })
112942025-08-12T22:55:14.378ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1195
112952025-08-12T22:55:14.411ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
112962025-08-12T22:55:14.411ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112972025-08-12T22:55:14.412ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dc03481-b8f9-459c-adad-a0cdfc032b93", "content-length": "26", "date": "Tue, 12 Aug 2025 22:55:14 GMT"} })
112982025-08-12T22:55:14.412ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112992025-08-12T22:55:14.412ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
113002025-08-12T22:55:14.443ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113012025-08-12T22:55:14.443ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113022025-08-12T22:55:14.447ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113032025-08-12T22:55:14.447ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113042025-08-12T22:55:14.452ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ReleaseVirtualProvisioning
113052025-08-12T22:55:14.452ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ReleaseVirtualProvisioning
113062025-08-12T22:55:14.464ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1115 instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-08-12T22:55:14.454079Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, time_modified: Some(2025-08-12T22:55:14.454079Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 83149d44-98a1-4a7a-a772-c8f0adc88be9, time_modified: Some(2025-08-12T22:55:14.454079Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
113072025-08-12T22:55:14.466ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113082025-08-12T22:55:14.466ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113092025-08-12T22:55:14.470ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113102025-08-12T22:55:14.470ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113112025-08-12T22:55:14.476ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1150 instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
113122025-08-12T22:55:14.476ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = UnassignOximeterProducer
113132025-08-12T22:55:14.477ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = UnassignOximeterProducer
113142025-08-12T22:55:14.482ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 4c467f25-cb67-42ad-b276-c490b467a350 producer_id = 1da12625-f9ed-42ef-894f-fed0bef616fc saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
113152025-08-12T22:55:14.482ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = UnassignOximeterProducer
113162025-08-12T22:55:14.482ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = UnassignOximeterProducer
113172025-08-12T22:55:14.517ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 1da12625-f9ed-42ef-894f-fed0bef616fc saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
113182025-08-12T22:55:14.517ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 1da12625-f9ed-42ef-894f-fed0bef616fc saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/1da12625-f9ed-42ef-894f-fed0bef616fc
113192025-08-12T22:55:14.529ZDEBGnexus (SagaExecutor): client response oximeter-collector = 1da12625-f9ed-42ef-894f-fed0bef616fc result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/1da12625-f9ed-42ef-894f-fed0bef616fc", status: 204, headers: {"x-request-id": "375411cc-c7f4-4533-a8ab-8960c6d93b43", "date": "Tue, 12 Aug 2025 22:55:14 GMT"} }) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
113202025-08-12T22:55:14.529ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 4c467f25-cb67-42ad-b276-c490b467a350 producer_id = 1da12625-f9ed-42ef-894f-fed0bef616fc saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
113212025-08-12T22:55:14.530ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113222025-08-12T22:55:14.530ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113232025-08-12T22:55:14.534ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113242025-08-12T22:55:14.534ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113252025-08-12T22:55:14.540ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc lock = UpdaterLock { updater_id: 85ce7750-ade5-4f96-83ca-8e97b3d247ff, locked_gen: Generation(Generation(3)) } new_intent = None new_runtime = InstanceRuntimeState { time_updated: 2025-08-12T22:55:14.249905586Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
113262025-08-12T22:55:14.540ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = CommitInstanceUpdates
113272025-08-12T22:55:14.541ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = CommitInstanceUpdates
113282025-08-12T22:55:14.552ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1201 instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc new_runtime = InstanceRuntimeState { time_updated: 2025-08-12T22:55:14.249905586Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
113292025-08-12T22:55:14.552ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
113302025-08-12T22:55:14.552ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
113312025-08-12T22:55:14.552ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
113322025-08-12T22:55:14.552ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113332025-08-12T22:55:14.552ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113342025-08-12T22:55:14.552ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113352025-08-12T22:55:14.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113362025-08-12T22:55:14.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113372025-08-12T22:55:14.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113382025-08-12T22:55:14.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113392025-08-12T22:55:14.556ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113402025-08-12T22:55:14.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113412025-08-12T22:55:14.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113422025-08-12T22:55:14.556ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113432025-08-12T22:55:14.556ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113442025-08-12T22:55:14.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113452025-08-12T22:55:14.560ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113462025-08-12T22:55:14.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113472025-08-12T22:55:14.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113482025-08-12T22:55:14.560ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113492025-08-12T22:55:14.560ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("1da12625-f9ed-42ef-894f-fed0bef616fc"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("205fe3a0-d63e-463f-a1aa-498054034a41")}) node_id = 7 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113502025-08-12T22:55:14.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113512025-08-12T22:55:14.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113522025-08-12T22:55:14.565ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113532025-08-12T22:55:14.565ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113542025-08-12T22:55:14.569ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113552025-08-12T22:55:14.569ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113562025-08-12T22:55:14.572ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113572025-08-12T22:55:14.573ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113582025-08-12T22:55:14.576ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:82 instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc propolis_id = 205fe3a0-d63e-463f-a1aa-498054034a41 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
113592025-08-12T22:55:14.576ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ReleaseSledResources
113602025-08-12T22:55:14.576ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ReleaseSledResources
113612025-08-12T22:55:14.587ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113622025-08-12T22:55:14.587ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113632025-08-12T22:55:14.590ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113642025-08-12T22:55:14.590ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113652025-08-12T22:55:14.593ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
113662025-08-12T22:55:14.593ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113672025-08-12T22:55:14.594ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:113 instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc propolis_id = 205fe3a0-d63e-463f-a1aa-498054034a41 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
113682025-08-12T22:55:14.594ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = MarkVmmDeleted
113692025-08-12T22:55:14.594ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "32904074-3784-4bcf-b494-b553a38662b9", "content-length": "372", "date": "Tue, 12 Aug 2025 22:55:14 GMT"} })
113702025-08-12T22:55:14.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113712025-08-12T22:55:14.594ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = MarkVmmDeleted
113722025-08-12T22:55:14.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113732025-08-12T22:55:14.607ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113742025-08-12T22:55:14.607ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113752025-08-12T22:55:14.611ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113762025-08-12T22:55:14.611ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113772025-08-12T22:55:14.614ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113782025-08-12T22:55:14.614ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113792025-08-12T22:55:14.617ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113802025-08-12T22:55:14.617ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113812025-08-12T22:55:14.621ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ChainSuccessorSaga
113822025-08-12T22:55:14.621ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ChainSuccessorSaga
113832025-08-12T22:55:14.623ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ChainSuccessorSaga
113842025-08-12T22:55:14.623ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ChainSuccessorSaga
113852025-08-12T22:55:14.624ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ChainSuccessorSaga
113862025-08-12T22:55:14.625ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ChainSuccessorSaga
113872025-08-12T22:55:14.626ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ChainSuccessorSaga
113882025-08-12T22:55:14.630ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, lookup_type: ById(4604c0f4-e471-4d75-8d0c-f1105f332e2d) }, key: 83149d44-98a1-4a7a-a772-c8f0adc88be9, lookup_type: ById(83149d44-98a1-4a7a-a772-c8f0adc88be9) }, key: 1da12625-f9ed-42ef-894f-fed0bef616fc, lookup_type: ById(1da12625-f9ed-42ef-894f-fed0bef616fc) } result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ChainSuccessorSaga
113892025-08-12T22:55:14.630ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ChainSuccessorSaga
113902025-08-12T22:55:14.630ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_node = ChainSuccessorSaga
113912025-08-12T22:55:14.633ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc intended_state = destroyed karmic_state = WillReincarnate needs_reincarnation = false saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update
113922025-08-12T22:55:14.633ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113932025-08-12T22:55:14.633ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113942025-08-12T22:55:14.637ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113952025-08-12T22:55:14.637ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113962025-08-12T22:55:14.641ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113972025-08-12T22:55:14.641ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
113982025-08-12T22:55:14.644ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
113992025-08-12T22:55:14.644ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab
114002025-08-12T22:55:14.661ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
114012025-08-12T22:55:14.661ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
114022025-08-12T22:55:14.661ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c09a7cbb-561c-484a-987d-769cbfdfabaf", "date": "Tue, 12 Aug 2025 22:55:14 GMT"} })
114032025-08-12T22:55:14.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114042025-08-12T22:55:14.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114052025-08-12T22:55:14.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114062025-08-12T22:55:14.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114072025-08-12T22:55:14.671ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114082025-08-12T22:55:14.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114092025-08-12T22:55:14.674ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
114102025-08-12T22:55:14.675ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114112025-08-12T22:55:14.675ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d6963d58-23df-4ac4-90a3-180bdb9b6364", "date": "Tue, 12 Aug 2025 22:55:14 GMT"} })
114122025-08-12T22:55:14.677ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 124.673042ms iteration = 25 status = {}
114132025-08-12T22:55:14.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114142025-08-12T22:55:14.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114152025-08-12T22:55:14.687ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114162025-08-12T22:55:14.689ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114172025-08-12T22:55:14.689ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114182025-08-12T22:55:14.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114192025-08-12T22:55:14.690ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114202025-08-12T22:55:14.692ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114212025-08-12T22:55:14.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114222025-08-12T22:55:14.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114232025-08-12T22:55:14.722ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
114242025-08-12T22:55:14.722ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:558 saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab saga_name = instance-update saga_result = SagaResult { saga_id: b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab, saga_log: SagaLog { saga_id: b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("85ce7750-ade5-4f96-83ca-8e97b3d247ff")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("85ce7750-ade5-4f96-83ca-8e97b3d247ff")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("1da12625-f9ed-42ef-894f-fed0bef616fc"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("205fe3a0-d63e-463f-a1aa-498054034a41")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("1da12625-f9ed-42ef-894f-fed0bef616fc"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("205fe3a0-d63e-463f-a1aa-498054034a41")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("85ce7750-ade5-4f96-83ca-8e97b3d247ff"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("85ce7750-ade5-4f96-83ca-8e97b3d247ff")}} }) }
114252025-08-12T22:55:14.722ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = b98c57f1-ccb8-4c6d-8bb2-afc7d47d3cab instance_id = 1da12625-f9ed-42ef-894f-fed0bef616fc saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update
114262025-08-12T22:55:14.722ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
114272025-08-12T22:55:14.722ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564
114282025-08-12T22:55:14.725ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
114292025-08-12T22:55:14.725ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fa55932-6109-458d-9af9-7d800c90c64c", "content-length": "691", "date": "Tue, 12 Aug 2025 22:55:14 GMT"} })
114302025-08-12T22:55:14.726ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
114312025-08-12T22:55:14.726ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
114322025-08-12T22:55:14.726ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
114332025-08-12T22:55:14.726ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 174.196827ms iteration = 25 status = {}
114342025-08-12T22:55:14.727ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
114352025-08-12T22:55:14.727ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564
114362025-08-12T22:55:14.730ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
114372025-08-12T22:55:14.730ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564
114382025-08-12T22:55:14.733ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
114392025-08-12T22:55:14.733ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564
114402025-08-12T22:55:14.740ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update sec_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
114412025-08-12T22:55:14.740ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:558 saga_id = b0ee2cb4-f4b9-4148-b518-4d230df67564 saga_name = start-instance-update saga_result = SagaResult { saga_id: b0ee2cb4-f4b9-4148-b518-4d230df67564, saga_log: SagaLog { saga_id: b0ee2cb4-f4b9-4148-b518-4d230df67564, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("b6bd27fc-e8a8-484f-ae99-807e33f71af3")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("b6bd27fc-e8a8-484f-ae99-807e33f71af3")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("b6bd27fc-e8a8-484f-ae99-807e33f71af3"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("b6bd27fc-e8a8-484f-ae99-807e33f71af3")}} }) }
114422025-08-12T22:55:15.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bf70e0b7-fdf3-4139-b3b8-ac65066a82a6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114432025-08-12T22:55:15.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bf70e0b7-fdf3-4139-b3b8-ac65066a82a6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114442025-08-12T22:55:15.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bf70e0b7-fdf3-4139-b3b8-ac65066a82a6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114452025-08-12T22:55:16.051ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 144 reason = Timeout
114462025-08-12T22:55:16.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
114472025-08-12T22:55:16.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
114482025-08-12T22:55:16.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114492025-08-12T22:55:16.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
114502025-08-12T22:55:16.058ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
114512025-08-12T22:55:16.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
114522025-08-12T22:55:16.061ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
114532025-08-12T22:55:16.061ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 10.27033ms iteration = 144 status = {"chicken_switches_updated":false}
114542025-08-12T22:55:16.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 932d2f87-b8f1-4274-9b74-39d285dbffd1 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114552025-08-12T22:55:16.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 932d2f87-b8f1-4274-9b74-39d285dbffd1 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114562025-08-12T22:55:16.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 932d2f87-b8f1-4274-9b74-39d285dbffd1 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114572025-08-12T22:55:17.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0a88c59e-f860-45c9-b273-84ccef8f2246 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114582025-08-12T22:55:17.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0a88c59e-f860-45c9-b273-84ccef8f2246 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114592025-08-12T22:55:17.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0a88c59e-f860-45c9-b273-84ccef8f2246 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114602025-08-12T22:55:18.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5a04ec31-2578-4647-bbb8-458b39913e97 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114612025-08-12T22:55:18.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5a04ec31-2578-4647-bbb8-458b39913e97 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114622025-08-12T22:55:18.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5a04ec31-2578-4647-bbb8-458b39913e97 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114632025-08-12T22:55:18.839ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 551 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 465ca639-00c2-4a82-a770-a28e0d7b3efe response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
114642025-08-12T22:55:19.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ba288c65-aef9-45be-92e4-fae5faa9793a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114652025-08-12T22:55:19.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ba288c65-aef9-45be-92e4-fae5faa9793a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114662025-08-12T22:55:19.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ba288c65-aef9-45be-92e4-fae5faa9793a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114672025-08-12T22:55:20.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b4508448-d303-4a9e-a333-f8cef41e554f roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114682025-08-12T22:55:20.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b4508448-d303-4a9e-a333-f8cef41e554f resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114692025-08-12T22:55:20.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b4508448-d303-4a9e-a333-f8cef41e554f response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
114702025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
114712025-08-12T22:55:21.050ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0
114722025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.52\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0"}
114732025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
114742025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
114752025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
114762025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
114772025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
114782025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
114792025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
114802025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
114812025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
114822025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
114832025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
114842025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
114852025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
114862025-08-12T22:55:21.050ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-12 22:45:21.050620232 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
114872025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
114882025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
114892025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
114902025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
114912025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
114922025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
114932025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114942025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
114952025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
114962025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114972025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
114982025-08-12T22:55:21.050ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
114992025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
115002025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
115012025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
115022025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
115032025-08-12T22:55:21.050ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
115042025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
115052025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
115062025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
115072025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
115082025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115092025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115102025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115112025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
115122025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
115132025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
115142025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115152025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
115162025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
115172025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115182025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115192025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 145 reason = Timeout
115202025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
115212025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
115222025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115232025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
115242025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
115252025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
115262025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
115272025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
115282025-08-12T22:55:21.050ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
115292025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115302025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 13 reason = Timeout
115312025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115322025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
115332025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
115342025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 13 reason = Timeout
115352025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
115362025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
115372025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 17 reason = Timeout
115382025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
115392025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 9.05\u{b5}s iteration = 17 status = "Disabled"
115402025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
115412025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
115422025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
115432025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
115442025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
115452025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115462025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 25 reason = Timeout
115472025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115482025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 8.08\u{b5}s iteration = 25 status = {"disabled":true,"errors":[],"sps":[]}
115492025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
115502025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
115512025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
115522025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
115532025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115542025-08-12T22:55:21.051ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3e3264d-303d-4ce7-a0ce-0090b10b154f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1723, tv_nsec: 282424828 } })
115552025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
115562025-08-12T22:55:21.051ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("043b8097-0e38-4228-bada-dac70e518148.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26cd5275-57f5-4466-a94f-f96956f55588.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1723, tv_nsec: 282474259 } })
115572025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
115582025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115592025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
115602025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115612025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
115622025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
115632025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115642025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115652025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
115662025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115672025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115682025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
115692025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
115702025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115712025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
115722025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
115732025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
115742025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
115752025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
115762025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115772025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115782025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115792025-08-12T22:55:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
115802025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
115812025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
115822025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.276013ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
115832025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
115842025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.411634ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
115852025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
115862025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
115872025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
115882025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
115892025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115902025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
115912025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
115922025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
115932025-08-12T22:55:21.052ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
115942025-08-12T22:55:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
115952025-08-12T22:55:21.053ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
115962025-08-12T22:55:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
115972025-08-12T22:55:21.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115982025-08-12T22:55:21.053ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115992025-08-12T22:55:21.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116002025-08-12T22:55:21.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.121661ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
116012025-08-12T22:55:21.054ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-12 22:45:21.050620232 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
116022025-08-12T22:55:21.054ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1723, tv_nsec: 285153235 } })
116032025-08-12T22:55:21.054ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.425773ms iteration = 13 status = {"expiration":"2025-08-12T22:45:21.050620232Z","pruned":[]}
116042025-08-12T22:55:21.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116052025-08-12T22:55:21.054ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
116062025-08-12T22:55:21.054ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1723, tv_nsec: 285595729 } })
116072025-08-12T22:55:21.054ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
116082025-08-12T22:55:21.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116092025-08-12T22:55:21.055ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.372143ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
116102025-08-12T22:55:21.055ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.015239ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
116112025-08-12T22:55:21.055ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116122025-08-12T22:55:21.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116132025-08-12T22:55:21.056ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116142025-08-12T22:55:21.056ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
116152025-08-12T22:55:21.056ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 5.547674ms iteration = 13 status = {"by_rx":{},"error":null}
116162025-08-12T22:55:21.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
116172025-08-12T22:55:21.058ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116182025-08-12T22:55:21.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116192025-08-12T22:55:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116202025-08-12T22:55:21.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116212025-08-12T22:55:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
116222025-08-12T22:55:21.058ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116232025-08-12T22:55:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116242025-08-12T22:55:21.058ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116252025-08-12T22:55:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
116262025-08-12T22:55:21.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116272025-08-12T22:55:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116282025-08-12T22:55:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
116292025-08-12T22:55:21.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
116302025-08-12T22:55:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
116312025-08-12T22:55:21.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116322025-08-12T22:55:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
116332025-08-12T22:55:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116342025-08-12T22:55:21.060ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116352025-08-12T22:55:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
116362025-08-12T22:55:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
116372025-08-12T22:55:21.061ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
116382025-08-12T22:55:21.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
116392025-08-12T22:55:21.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116402025-08-12T22:55:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
116412025-08-12T22:55:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116422025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
116432025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
116442025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
116452025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
116462025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
116472025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116482025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
116492025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
116502025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 14.804245ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
116512025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
116522025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
116532025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
116542025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
116552025-08-12T22:55:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
116562025-08-12T22:55:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116572025-08-12T22:55:21.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116582025-08-12T22:55:21.067ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
116592025-08-12T22:55:21.067ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
116602025-08-12T22:55:21.067ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
116612025-08-12T22:55:21.067ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
116622025-08-12T22:55:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116632025-08-12T22:55:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
116642025-08-12T22:55:21.068ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116652025-08-12T22:55:21.069ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 18.204099ms iteration = 13 status = {"dispatched":[],"errors":[],"glob_version":"180.0.0","globs_reprocessed":{},"no_receivers":[]}
116662025-08-12T22:55:21.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116672025-08-12T22:55:21.069ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1723, tv_nsec: 300907480 } })
116682025-08-12T22:55:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116692025-08-12T22:55:21.070ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
116702025-08-12T22:55:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
116712025-08-12T22:55:21.070ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
116722025-08-12T22:55:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
116732025-08-12T22:55:21.070ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116742025-08-12T22:55:21.071ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116752025-08-12T22:55:21.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116762025-08-12T22:55:21.073ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116772025-08-12T22:55:21.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
116782025-08-12T22:55:21.073ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
116792025-08-12T22:55:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
116802025-08-12T22:55:21.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116812025-08-12T22:55:21.075ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
116822025-08-12T22:55:21.075ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 24.209938ms iteration = 145 status = {"chicken_switches_updated":false}
116832025-08-12T22:55:21.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116842025-08-12T22:55:21.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116852025-08-12T22:55:21.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
116862025-08-12T22:55:21.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116872025-08-12T22:55:21.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116882025-08-12T22:55:21.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
116892025-08-12T22:55:21.077ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116902025-08-12T22:55:21.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
116912025-08-12T22:55:21.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116922025-08-12T22:55:21.077ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116932025-08-12T22:55:21.078ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116942025-08-12T22:55:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116952025-08-12T22:55:21.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116962025-08-12T22:55:21.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116972025-08-12T22:55:21.080ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116982025-08-12T22:55:21.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116992025-08-12T22:55:21.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
117002025-08-12T22:55:21.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117012025-08-12T22:55:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117022025-08-12T22:55:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
117032025-08-12T22:55:21.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117042025-08-12T22:55:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117052025-08-12T22:55:21.108ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117062025-08-12T22:55:21.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117072025-08-12T22:55:21.109ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117082025-08-12T22:55:21.111ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117092025-08-12T22:55:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117102025-08-12T22:55:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
117112025-08-12T22:55:21.111ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
117122025-08-12T22:55:21.111ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117132025-08-12T22:55:21.111ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
117142025-08-12T22:55:21.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117152025-08-12T22:55:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
117162025-08-12T22:55:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117172025-08-12T22:55:21.112ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
117182025-08-12T22:55:21.112ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
117192025-08-12T22:55:21.112ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.242131ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
117202025-08-12T22:55:21.114ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 64.302261ms iteration = 6 status = {"nsuccess":5}
117212025-08-12T22:55:21.115ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117222025-08-12T22:55:21.115ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117232025-08-12T22:55:21.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.489652ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
117242025-08-12T22:55:21.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
117252025-08-12T22:55:21.117ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
117262025-08-12T22:55:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
117272025-08-12T22:55:21.120ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
117282025-08-12T22:55:21.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
117292025-08-12T22:55:21.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
117302025-08-12T22:55:21.123ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117312025-08-12T22:55:21.123ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
117322025-08-12T22:55:21.123ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117332025-08-12T22:55:21.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117342025-08-12T22:55:21.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 73.377369ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
117352025-08-12T22:55:21.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117362025-08-12T22:55:21.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117372025-08-12T22:55:21.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117382025-08-12T22:55:21.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117392025-08-12T22:55:21.132ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
117402025-08-12T22:55:21.132ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.51174ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
117412025-08-12T22:55:21.133ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117422025-08-12T22:55:21.135ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117432025-08-12T22:55:21.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
117442025-08-12T22:55:21.136ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
117452025-08-12T22:55:21.136ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
117462025-08-12T22:55:21.136ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.355917ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
117472025-08-12T22:55:21.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
117482025-08-12T22:55:21.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117492025-08-12T22:55:21.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117502025-08-12T22:55:21.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.127454ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
117512025-08-12T22:55:21.139ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.020793ms iteration = 25 status = 0
117522025-08-12T22:55:21.139ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
117532025-08-12T22:55:21.139ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.998153ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
117542025-08-12T22:55:21.141ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117552025-08-12T22:55:21.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117562025-08-12T22:55:21.143ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117572025-08-12T22:55:21.145ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
117582025-08-12T22:55:21.145ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117592025-08-12T22:55:21.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117602025-08-12T22:55:21.151ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 100.525196ms iteration = 28 status = {"physical_disks_added":0}
117612025-08-12T22:55:21.165ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117622025-08-12T22:55:21.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117632025-08-12T22:55:21.168ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
117642025-08-12T22:55:21.168ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
117652025-08-12T22:55:21.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117662025-08-12T22:55:21.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 117.641194ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
117672025-08-12T22:55:21.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117682025-08-12T22:55:21.169ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
117692025-08-12T22:55:21.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
117702025-08-12T22:55:21.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 118.984807ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117712025-08-12T22:55:21.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117722025-08-12T22:55:21.171ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117732025-08-12T22:55:21.173ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
117742025-08-12T22:55:21.173ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
117752025-08-12T22:55:21.173ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
117762025-08-12T22:55:21.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
117772025-08-12T22:55:21.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
117782025-08-12T22:55:21.173ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
117792025-08-12T22:55:21.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
117802025-08-12T22:55:21.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
117812025-08-12T22:55:21.175ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117822025-08-12T22:55:21.175ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
117832025-08-12T22:55:21.175ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117842025-08-12T22:55:21.175ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.271959ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
117852025-08-12T22:55:21.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
117862025-08-12T22:55:21.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117872025-08-12T22:55:21.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117882025-08-12T22:55:21.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
117892025-08-12T22:55:21.178ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
117902025-08-12T22:55:21.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
117912025-08-12T22:55:21.179ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
117922025-08-12T22:55:21.179ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
117932025-08-12T22:55:21.179ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-12 22:43:49.909589 UTC dns_group = internal generation = 1
117942025-08-12T22:55:21.179ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 128.889224ms iteration = 13 status = {"generation":1}
117952025-08-12T22:55:21.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
117962025-08-12T22:55:21.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
117972025-08-12T22:55:21.206ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
117982025-08-12T22:55:21.206ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 155.268283ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
117992025-08-12T22:55:21.207ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-12T22:43:09.981233Z, time_modified: 2025-08-12T22:43:09.981233Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
118002025-08-12T22:55:21.207ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 157.01724ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]}},"default_endpoint":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
118012025-08-12T22:55:21.216ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
118022025-08-12T22:55:21.216ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 0 version = 2
118032025-08-12T22:55:21.216ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118042025-08-12T22:55:21.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118052025-08-12T22:55:21.218ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118062025-08-12T22:55:21.220ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
118072025-08-12T22:55:21.220ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 169.631594ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
118082025-08-12T22:55:21.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
118092025-08-12T22:55:21.221ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118102025-08-12T22:55:21.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118112025-08-12T22:55:21.223ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 4 version = 2
118122025-08-12T22:55:21.223ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
118132025-08-12T22:55:21.223ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-12 22:43:50.527483 UTC dns_group = external generation = 2
118142025-08-12T22:55:21.223ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 172.965977ms iteration = 13 status = {"generation":2}
118152025-08-12T22:55:21.229ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
118162025-08-12T22:55:21.229ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118172025-08-12T22:55:21.230ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03aaf67c-1c10-4bba-a3c5-7b3c10cf4b71", "content-length": "26", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} })
118182025-08-12T22:55:21.230ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118192025-08-12T22:55:21.231ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118202025-08-12T22:55:21.234ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
118212025-08-12T22:55:21.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118222025-08-12T22:55:21.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118232025-08-12T22:55:21.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118242025-08-12T22:55:21.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118252025-08-12T22:55:21.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118262025-08-12T22:55:21.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118272025-08-12T22:55:21.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118282025-08-12T22:55:21.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118292025-08-12T22:55:21.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118302025-08-12T22:55:21.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118312025-08-12T22:55:21.246ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
118322025-08-12T22:55:21.246ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118332025-08-12T22:55:21.247ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d72042b9-4ce3-4ab1-bd09-98e6bdaef962", "content-length": "26", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} })
118342025-08-12T22:55:21.247ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118352025-08-12T22:55:21.249ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
118362025-08-12T22:55:21.276ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
118372025-08-12T22:55:21.276ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118382025-08-12T22:55:21.277ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b26669d8-9844-4f7f-871e-48d8a9dae0a3", "content-length": "372", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} })
118392025-08-12T22:55:21.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118402025-08-12T22:55:21.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118412025-08-12T22:55:21.325ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
118422025-08-12T22:55:21.336ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
118432025-08-12T22:55:21.337ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
118442025-08-12T22:55:21.337ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "eedce734-edd3-4e46-8e78-f08a6c7bfe68", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} })
118452025-08-12T22:55:21.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118462025-08-12T22:55:21.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118472025-08-12T22:55:21.340ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118482025-08-12T22:55:21.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118492025-08-12T22:55:21.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c27aad81-a534-4123-9a72-0b396eaa8267 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
118502025-08-12T22:55:21.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c27aad81-a534-4123-9a72-0b396eaa8267 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
118512025-08-12T22:55:21.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c27aad81-a534-4123-9a72-0b396eaa8267 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
118522025-08-12T22:55:21.343ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118532025-08-12T22:55:21.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118542025-08-12T22:55:21.347ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
118552025-08-12T22:55:21.347ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118562025-08-12T22:55:21.348ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1b5396d9-9a52-43b3-bccc-0828fed5a590", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} })
118572025-08-12T22:55:21.349ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 299.051853ms iteration = 26 status = {}
118582025-08-12T22:55:21.368ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
118592025-08-12T22:55:21.368ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118602025-08-12T22:55:21.368ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc1ba43e-663b-4237-bd27-0619cf42a3fd", "content-length": "26", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} })
118612025-08-12T22:55:21.368ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118622025-08-12T22:55:21.372ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118632025-08-12T22:55:21.385ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
118642025-08-12T22:55:21.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118652025-08-12T22:55:21.389ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 338.916395ms iteration = 25 status = null
118662025-08-12T22:55:21.397ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
118672025-08-12T22:55:21.467ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
118682025-08-12T22:55:21.467ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c90a35e-489d-4325-a079-41025ce8c666", "content-length": "691", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} })
118692025-08-12T22:55:21.467ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
118702025-08-12T22:55:21.467ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
118712025-08-12T22:55:21.467ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
118722025-08-12T22:55:21.469ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 418.790578ms iteration = 26 status = {}
118732025-08-12T22:55:21.488ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
118742025-08-12T22:55:21.488ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1709ec8e-a45d-4183-9780-97faf6acc330", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
118752025-08-12T22:55:21.488ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
118762025-08-12T22:55:21.491ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8e23276a-e056-48ea-883f-e87620b03c28", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
118772025-08-12T22:55:21.491ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
118782025-08-12T22:55:21.493ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
118792025-08-12T22:55:21.493ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 442.910814ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
118802025-08-12T22:55:21.507ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
118812025-08-12T22:55:21.507ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d2f503ae-8e18-4118-8af1-8eaa2ea60e27", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
118822025-08-12T22:55:21.510ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
118832025-08-12T22:55:21.511ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 460.669968ms iteration = 25 status = {}
118842025-08-12T22:55:21.512ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1b96c1a2-89cd-49f7-8bb9-8adccebd1242", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
118852025-08-12T22:55:21.512ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
118862025-08-12T22:55:21.514ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e9c59274-acb4-4eb5-8d51-210a43c85665", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
118872025-08-12T22:55:21.514ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
118882025-08-12T22:55:21.516ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
118892025-08-12T22:55:21.516ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 466.092412ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
118902025-08-12T22:55:21.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118912025-08-12T22:55:21.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118922025-08-12T22:55:21.542ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
118932025-08-12T22:55:21.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118942025-08-12T22:55:21.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118952025-08-12T22:55:21.556ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
118962025-08-12T22:55:21.556ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
118972025-08-12T22:55:21.557ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
118982025-08-12T22:55:21.557ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
118992025-08-12T22:55:21.557ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119002025-08-12T22:55:21.557ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119012025-08-12T22:55:21.557ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119022025-08-12T22:55:21.557ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119032025-08-12T22:55:21.557ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119042025-08-12T22:55:21.557ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119052025-08-12T22:55:21.557ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
119062025-08-12T22:55:21.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119072025-08-12T22:55:21.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119082025-08-12T22:55:21.560ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
119092025-08-12T22:55:21.561ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
119102025-08-12T22:55:21.674ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1d6a6f51-9f40-4fdc-8af3-9ca465124ee6", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} })
119112025-08-12T22:55:21.674ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
119122025-08-12T22:55:21.674ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
119132025-08-12T22:55:21.675ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9b802ad-fa94-4952-b11d-8e3a8ef6f659", "content-length": "682", "date": "Tue, 12 Aug 2025 22:55:21 GMT"} })
119142025-08-12T22:55:21.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119152025-08-12T22:55:21.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119162025-08-12T22:55:21.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119172025-08-12T22:55:21.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119182025-08-12T22:55:21.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119192025-08-12T22:55:21.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119202025-08-12T22:55:21.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119212025-08-12T22:55:21.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119222025-08-12T22:55:21.693ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 643.116608ms iteration = 25 status = {}
119232025-08-12T22:55:22.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1f86e304-2932-42a9-bcc0-20dcc6037cda roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119242025-08-12T22:55:22.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1f86e304-2932-42a9-bcc0-20dcc6037cda resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119252025-08-12T22:55:22.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1f86e304-2932-42a9-bcc0-20dcc6037cda response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119262025-08-12T22:55:23.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 60a07306-ec6c-4bef-bc93-cea384c2caaa roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119272025-08-12T22:55:23.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 60a07306-ec6c-4bef-bc93-cea384c2caaa resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119282025-08-12T22:55:23.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 60a07306-ec6c-4bef-bc93-cea384c2caaa response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119292025-08-12T22:55:24.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eea0e989-d55c-4f36-9290-5d14071d8c87 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119302025-08-12T22:55:24.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eea0e989-d55c-4f36-9290-5d14071d8c87 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119312025-08-12T22:55:24.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eea0e989-d55c-4f36-9290-5d14071d8c87 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119322025-08-12T22:55:25.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3d7e8cfe-6a81-4989-a1cb-72b724dd9c62 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119332025-08-12T22:55:25.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3d7e8cfe-6a81-4989-a1cb-72b724dd9c62 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119342025-08-12T22:55:25.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3d7e8cfe-6a81-4989-a1cb-72b724dd9c62 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119352025-08-12T22:55:26.051ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 146 reason = Timeout
119362025-08-12T22:55:26.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
119372025-08-12T22:55:26.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
119382025-08-12T22:55:26.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119392025-08-12T22:55:26.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
119402025-08-12T22:55:26.056ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
119412025-08-12T22:55:26.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
119422025-08-12T22:55:26.058ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
119432025-08-12T22:55:26.058ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.470233ms iteration = 146 status = {"chicken_switches_updated":false}
119442025-08-12T22:55:26.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5f485275-9245-4538-9186-229c1efaae73 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119452025-08-12T22:55:26.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5f485275-9245-4538-9186-229c1efaae73 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119462025-08-12T22:55:26.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5f485275-9245-4538-9186-229c1efaae73 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119472025-08-12T22:55:27.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5e9bdd30-68f6-44b7-91af-c7a439c5662d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119482025-08-12T22:55:27.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5e9bdd30-68f6-44b7-91af-c7a439c5662d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119492025-08-12T22:55:27.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 5e9bdd30-68f6-44b7-91af-c7a439c5662d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119502025-08-12T22:55:28.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 51691687-97c9-4f26-818b-e39167ce415b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119512025-08-12T22:55:28.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 51691687-97c9-4f26-818b-e39167ce415b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119522025-08-12T22:55:28.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 51691687-97c9-4f26-818b-e39167ce415b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119532025-08-12T22:55:28.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = abe7aa6a-c3c7-48b6-91da-1c8cd5531446 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
119542025-08-12T22:55:28.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = abe7aa6a-c3c7-48b6-91da-1c8cd5531446 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
119552025-08-12T22:55:28.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = abe7aa6a-c3c7-48b6-91da-1c8cd5531446 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
119562025-08-12T22:55:28.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = a625cd03-f641-4e81-a90f-6a0784751e2b roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
119572025-08-12T22:55:28.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = a625cd03-f641-4e81-a90f-6a0784751e2b resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
119582025-08-12T22:55:28.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = a625cd03-f641-4e81-a90f-6a0784751e2b response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
119592025-08-12T22:55:28.839ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 588 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 7d498f4b-4c1a-40bd-8698-e97bbf9d7ae9 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
119602025-08-12T22:55:29.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a15d0a09-0ac2-4f99-bec1-0e10732f9ae0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119612025-08-12T22:55:29.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a15d0a09-0ac2-4f99-bec1-0e10732f9ae0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119622025-08-12T22:55:29.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a15d0a09-0ac2-4f99-bec1-0e10732f9ae0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119632025-08-12T22:55:30.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2de92581-5b24-40b1-be5c-476f3f1466c0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119642025-08-12T22:55:30.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2de92581-5b24-40b1-be5c-476f3f1466c0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119652025-08-12T22:55:30.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2de92581-5b24-40b1-be5c-476f3f1466c0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119662025-08-12T22:55:31.051ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
119672025-08-12T22:55:31.051ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
119682025-08-12T22:55:31.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119692025-08-12T22:55:31.051ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 147 reason = Timeout
119702025-08-12T22:55:31.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119712025-08-12T22:55:31.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
119722025-08-12T22:55:31.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
119732025-08-12T22:55:31.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119742025-08-12T22:55:31.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119752025-08-12T22:55:31.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119762025-08-12T22:55:31.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119772025-08-12T22:55:31.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
119782025-08-12T22:55:31.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119792025-08-12T22:55:31.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119802025-08-12T22:55:31.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
119812025-08-12T22:55:31.058ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
119822025-08-12T22:55:31.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
119832025-08-12T22:55:31.060ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
119842025-08-12T22:55:31.060ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 9.21692ms iteration = 147 status = {"chicken_switches_updated":false}
119852025-08-12T22:55:31.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119862025-08-12T22:55:31.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119872025-08-12T22:55:31.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119882025-08-12T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
119892025-08-12T22:55:31.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119902025-08-12T22:55:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119912025-08-12T22:55:31.088ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
119922025-08-12T22:55:31.088ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.7096ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
119932025-08-12T22:55:31.097ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119942025-08-12T22:55:31.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119952025-08-12T22:55:31.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.379274ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119962025-08-12T22:55:31.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4f2a5e1f-cede-4fb1-b308-982f24319126 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119972025-08-12T22:55:31.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4f2a5e1f-cede-4fb1-b308-982f24319126 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119982025-08-12T22:55:31.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4f2a5e1f-cede-4fb1-b308-982f24319126 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
119992025-08-12T22:55:32.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1de0cf10-5ebb-489d-b9a2-36ccbddd9653 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120002025-08-12T22:55:32.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1de0cf10-5ebb-489d-b9a2-36ccbddd9653 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120012025-08-12T22:55:32.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1de0cf10-5ebb-489d-b9a2-36ccbddd9653 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120022025-08-12T22:55:33.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c982fdf2-abce-4cef-8865-596acd1caf9d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120032025-08-12T22:55:33.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c982fdf2-abce-4cef-8865-596acd1caf9d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120042025-08-12T22:55:33.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c982fdf2-abce-4cef-8865-596acd1caf9d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120052025-08-12T22:55:34.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e1eef0d4-d0df-44c4-8ad5-9b1de9287915 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120062025-08-12T22:55:34.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e1eef0d4-d0df-44c4-8ad5-9b1de9287915 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120072025-08-12T22:55:34.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e1eef0d4-d0df-44c4-8ad5-9b1de9287915 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120082025-08-12T22:55:35.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = da73aa04-35be-4c0f-8980-8d3222f999cf roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120092025-08-12T22:55:35.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = da73aa04-35be-4c0f-8980-8d3222f999cf resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120102025-08-12T22:55:35.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = da73aa04-35be-4c0f-8980-8d3222f999cf response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120112025-08-12T22:55:36.051ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 148 reason = Timeout
120122025-08-12T22:55:36.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
120132025-08-12T22:55:36.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
120142025-08-12T22:55:36.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120152025-08-12T22:55:36.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
120162025-08-12T22:55:36.056ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
120172025-08-12T22:55:36.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
120182025-08-12T22:55:36.059ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
120192025-08-12T22:55:36.059ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.070139ms iteration = 148 status = {"chicken_switches_updated":false}
120202025-08-12T22:55:36.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d83c7162-f1dc-42d0-b04f-b05eb6b2ba7c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120212025-08-12T22:55:36.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d83c7162-f1dc-42d0-b04f-b05eb6b2ba7c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120222025-08-12T22:55:36.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d83c7162-f1dc-42d0-b04f-b05eb6b2ba7c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120232025-08-12T22:55:37.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bbb4634e-7ad1-4634-b4a9-211ee0b3c3a7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120242025-08-12T22:55:37.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bbb4634e-7ad1-4634-b4a9-211ee0b3c3a7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120252025-08-12T22:55:37.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bbb4634e-7ad1-4634-b4a9-211ee0b3c3a7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120262025-08-12T22:55:38.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = efc100d1-7d49-402a-9c63-3be8732d74b6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120272025-08-12T22:55:38.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = efc100d1-7d49-402a-9c63-3be8732d74b6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120282025-08-12T22:55:38.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = efc100d1-7d49-402a-9c63-3be8732d74b6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120292025-08-12T22:55:38.838ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 602 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 42252b38-4014-47c8-beb6-0029e4f7be71 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
120302025-08-12T22:55:39.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a26c9df4-9619-432a-ada8-4d40b3a10f48 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120312025-08-12T22:55:39.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a26c9df4-9619-432a-ada8-4d40b3a10f48 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120322025-08-12T22:55:39.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a26c9df4-9619-432a-ada8-4d40b3a10f48 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120332025-08-12T22:55:40.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9e4a0d87-f343-452f-81f8-1872ccb2bec5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120342025-08-12T22:55:40.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9e4a0d87-f343-452f-81f8-1872ccb2bec5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120352025-08-12T22:55:40.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9e4a0d87-f343-452f-81f8-1872ccb2bec5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120362025-08-12T22:55:41.051ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
120372025-08-12T22:55:41.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120382025-08-12T22:55:41.051ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
120392025-08-12T22:55:41.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120402025-08-12T22:55:41.051ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 149 reason = Timeout
120412025-08-12T22:55:41.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
120422025-08-12T22:55:41.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120432025-08-12T22:55:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
120442025-08-12T22:55:41.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120452025-08-12T22:55:41.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120462025-08-12T22:55:41.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120472025-08-12T22:55:41.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
120482025-08-12T22:55:41.057ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
120492025-08-12T22:55:41.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120502025-08-12T22:55:41.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120512025-08-12T22:55:41.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
120522025-08-12T22:55:41.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120532025-08-12T22:55:41.059ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
120542025-08-12T22:55:41.059ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.015439ms iteration = 149 status = {"chicken_switches_updated":false}
120552025-08-12T22:55:41.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120562025-08-12T22:55:41.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120572025-08-12T22:55:41.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120582025-08-12T22:55:41.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
120592025-08-12T22:55:41.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120602025-08-12T22:55:41.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120612025-08-12T22:55:41.081ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
120622025-08-12T22:55:41.081ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.180046ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
120632025-08-12T22:55:41.090ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120642025-08-12T22:55:41.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120652025-08-12T22:55:41.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.311516ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120662025-08-12T22:55:41.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0948fe51-a765-4777-8261-39fd94954884 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120672025-08-12T22:55:41.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0948fe51-a765-4777-8261-39fd94954884 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120682025-08-12T22:55:41.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0948fe51-a765-4777-8261-39fd94954884 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120692025-08-12T22:55:42.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 54b60fed-ea31-4e7b-a036-a8eb20e439fe roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120702025-08-12T22:55:42.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 54b60fed-ea31-4e7b-a036-a8eb20e439fe resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120712025-08-12T22:55:42.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 54b60fed-ea31-4e7b-a036-a8eb20e439fe response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120722025-08-12T22:55:43.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eb82ba8b-a530-4dd6-a97b-2290ec997835 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120732025-08-12T22:55:43.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eb82ba8b-a530-4dd6-a97b-2290ec997835 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120742025-08-12T22:55:43.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eb82ba8b-a530-4dd6-a97b-2290ec997835 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120752025-08-12T22:55:43.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = f4ab0ada-203e-4751-a3df-766714e05166 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
120762025-08-12T22:55:43.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = f4ab0ada-203e-4751-a3df-766714e05166 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
120772025-08-12T22:55:43.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = f4ab0ada-203e-4751-a3df-766714e05166 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
120782025-08-12T22:55:43.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 4e3e8810-a325-4ebc-87a7-b07b95609f78 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
120792025-08-12T22:55:43.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 4e3e8810-a325-4ebc-87a7-b07b95609f78 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
120802025-08-12T22:55:43.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 4e3e8810-a325-4ebc-87a7-b07b95609f78 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
120812025-08-12T22:55:44.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 43ecc1c6-8ab0-46c3-a709-54f31fa9d252 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120822025-08-12T22:55:44.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 43ecc1c6-8ab0-46c3-a709-54f31fa9d252 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120832025-08-12T22:55:44.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 43ecc1c6-8ab0-46c3-a709-54f31fa9d252 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120842025-08-12T22:55:45.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 573ddcb6-43cf-4c24-ad2a-56e0eaa8cdd6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120852025-08-12T22:55:45.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 573ddcb6-43cf-4c24-ad2a-56e0eaa8cdd6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120862025-08-12T22:55:45.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 573ddcb6-43cf-4c24-ad2a-56e0eaa8cdd6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120872025-08-12T22:55:46.051ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 150 reason = Timeout
120882025-08-12T22:55:46.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
120892025-08-12T22:55:46.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
120902025-08-12T22:55:46.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120912025-08-12T22:55:46.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
120922025-08-12T22:55:46.056ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
120932025-08-12T22:55:46.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
120942025-08-12T22:55:46.058ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
120952025-08-12T22:55:46.058ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.943039ms iteration = 150 status = {"chicken_switches_updated":false}
120962025-08-12T22:55:46.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4ad05bec-8430-4047-ad3a-c4a5d596cb58 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120972025-08-12T22:55:46.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4ad05bec-8430-4047-ad3a-c4a5d596cb58 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120982025-08-12T22:55:46.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4ad05bec-8430-4047-ad3a-c4a5d596cb58 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
120992025-08-12T22:55:47.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4e185682-c21a-4877-bfcf-ff3f5545821e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
121002025-08-12T22:55:47.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4e185682-c21a-4877-bfcf-ff3f5545821e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
121012025-08-12T22:55:47.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4e185682-c21a-4877-bfcf-ff3f5545821e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
121022025-08-12T22:55:48.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e7ff7d32-1b2d-44af-a8d9-18daf5a72f5c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
121032025-08-12T22:55:48.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e7ff7d32-1b2d-44af-a8d9-18daf5a72f5c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
121042025-08-12T22:55:48.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e7ff7d32-1b2d-44af-a8d9-18daf5a72f5c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
121052025-08-12T22:55:48.839ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 837 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 71caaaf3-ea25-4e42-b02d-c44107f1fd9a response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
121062025-08-12T22:55:49.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 22007158-d558-448a-adad-8a39092055d6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
121072025-08-12T22:55:49.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 22007158-d558-448a-adad-8a39092055d6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
121082025-08-12T22:55:49.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 22007158-d558-448a-adad-8a39092055d6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
121092025-08-12T22:55:50.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ea7bbdaa-3a83-463e-83ad-9fa7c19cd78b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
121102025-08-12T22:55:50.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ea7bbdaa-3a83-463e-83ad-9fa7c19cd78b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
121112025-08-12T22:55:50.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ea7bbdaa-3a83-463e-83ad-9fa7c19cd78b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
121122025-08-12T22:55:51.050ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
121132025-08-12T22:55:51.050ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
121142025-08-12T22:55:51.050ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
121152025-08-12T22:55:51.050ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
121162025-08-12T22:55:51.050ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
121172025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
121182025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
121192025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 26 reason = Timeout
121202025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
121212025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
121222025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 15.07\u{b5}s iteration = 26 status = {"disabled":true,"errors":[],"sps":[]}
121232025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
121242025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
121252025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121262025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
121272025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
121282025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121292025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
121302025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121312025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 151 reason = Timeout
121322025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
121332025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
121342025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
121352025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
121362025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
121372025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
121382025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
121392025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121402025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121412025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
121422025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
121432025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
121442025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
121452025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
121462025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
121472025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121482025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
121492025-08-12T22:55:51.051ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
121502025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121512025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
121522025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
121532025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
121542025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
121552025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
121562025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
121572025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
121582025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121592025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121602025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
121612025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
121622025-08-12T22:55:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121632025-08-12T22:55:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121642025-08-12T22:55:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
121652025-08-12T22:55:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121662025-08-12T22:55:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121672025-08-12T22:55:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
121682025-08-12T22:55:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121692025-08-12T22:55:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
121702025-08-12T22:55:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
121712025-08-12T22:55:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
121722025-08-12T22:55:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
121732025-08-12T22:55:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
121742025-08-12T22:55:51.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121752025-08-12T22:55:51.054ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1753, tv_nsec: 284685638 } })
121762025-08-12T22:55:51.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121772025-08-12T22:55:51.054ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1753, tv_nsec: 284925411 } })
121782025-08-12T22:55:51.054ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.616695ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
121792025-08-12T22:55:51.054ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
121802025-08-12T22:55:51.054ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
121812025-08-12T22:55:51.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121822025-08-12T22:55:51.056ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
121832025-08-12T22:55:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
121842025-08-12T22:55:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
121852025-08-12T22:55:51.058ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
121862025-08-12T22:55:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
121872025-08-12T22:55:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
121882025-08-12T22:55:51.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121892025-08-12T22:55:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121902025-08-12T22:55:51.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
121912025-08-12T22:55:51.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121922025-08-12T22:55:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121932025-08-12T22:55:51.060ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
121942025-08-12T22:55:51.060ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 9.1187ms iteration = 151 status = {"chicken_switches_updated":false}
121952025-08-12T22:55:51.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121962025-08-12T22:55:51.061ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1753, tv_nsec: 291768078 } })
121972025-08-12T22:55:51.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121982025-08-12T22:55:51.061ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
121992025-08-12T22:55:51.062ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122002025-08-12T22:55:51.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122012025-08-12T22:55:51.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122022025-08-12T22:55:51.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122032025-08-12T22:55:51.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122042025-08-12T22:55:51.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122052025-08-12T22:55:51.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122062025-08-12T22:55:51.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122072025-08-12T22:55:51.088ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122082025-08-12T22:55:51.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122092025-08-12T22:55:51.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122102025-08-12T22:55:51.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122112025-08-12T22:55:51.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122122025-08-12T22:55:51.094ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122132025-08-12T22:55:51.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122142025-08-12T22:55:51.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122152025-08-12T22:55:51.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.361434ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
122162025-08-12T22:55:51.104ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122172025-08-12T22:55:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122182025-08-12T22:55:51.104ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122192025-08-12T22:55:51.104ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
122202025-08-12T22:55:51.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122212025-08-12T22:55:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122222025-08-12T22:55:51.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122232025-08-12T22:55:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122242025-08-12T22:55:51.110ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122252025-08-12T22:55:51.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
122262025-08-12T22:55:51.112ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122272025-08-12T22:55:51.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122282025-08-12T22:55:51.113ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 62.362512ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
122292025-08-12T22:55:51.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122302025-08-12T22:55:51.115ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122312025-08-12T22:55:51.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122322025-08-12T22:55:51.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122332025-08-12T22:55:51.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122342025-08-12T22:55:51.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
122352025-08-12T22:55:51.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122362025-08-12T22:55:51.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.837646ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
122372025-08-12T22:55:51.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
122382025-08-12T22:55:51.118ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122392025-08-12T22:55:51.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
122402025-08-12T22:55:51.118ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
122412025-08-12T22:55:51.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
122422025-08-12T22:55:51.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122432025-08-12T22:55:51.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122442025-08-12T22:55:51.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122452025-08-12T22:55:51.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122462025-08-12T22:55:51.120ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 69.31872ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
122472025-08-12T22:55:51.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
122482025-08-12T22:55:51.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122492025-08-12T22:55:51.121ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122502025-08-12T22:55:51.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122512025-08-12T22:55:51.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122522025-08-12T22:55:51.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122532025-08-12T22:55:51.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122542025-08-12T22:55:51.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122552025-08-12T22:55:51.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122562025-08-12T22:55:51.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122572025-08-12T22:55:51.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122582025-08-12T22:55:51.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
122592025-08-12T22:55:51.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122602025-08-12T22:55:51.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122612025-08-12T22:55:51.145ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122622025-08-12T22:55:51.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122632025-08-12T22:55:51.147ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
122642025-08-12T22:55:51.147ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122652025-08-12T22:55:51.148ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122662025-08-12T22:55:51.148ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
122672025-08-12T22:55:51.148ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122682025-08-12T22:55:51.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122692025-08-12T22:55:51.148ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b25374e6-d751-4272-ab81-40d5ac4e73d3", "content-length": "26", "date": "Tue, 12 Aug 2025 22:55:51 GMT"} })
122702025-08-12T22:55:51.148ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122712025-08-12T22:55:51.149ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
122722025-08-12T22:55:51.149ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122732025-08-12T22:55:51.149ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122742025-08-12T22:55:51.150ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1b54e51-08ae-427e-8a81-13cca5f1b19f", "content-length": "26", "date": "Tue, 12 Aug 2025 22:55:51 GMT"} })
122752025-08-12T22:55:51.150ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122762025-08-12T22:55:51.150ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
122772025-08-12T22:55:51.150ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 98.8584ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
122782025-08-12T22:55:51.151ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.136372ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
122792025-08-12T22:55:51.151ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122802025-08-12T22:55:51.153ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
122812025-08-12T22:55:51.153ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122822025-08-12T22:55:51.153ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8050c031-9c45-428b-9711-08ef72807030", "content-length": "26", "date": "Tue, 12 Aug 2025 22:55:51 GMT"} })
122832025-08-12T22:55:51.153ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122842025-08-12T22:55:51.154ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
122852025-08-12T22:55:51.160ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
122862025-08-12T22:55:51.160ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 108.994258ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
122872025-08-12T22:55:51.166ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
122882025-08-12T22:55:51.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
122892025-08-12T22:55:51.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 117.603994ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
122902025-08-12T22:55:51.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122912025-08-12T22:55:51.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122922025-08-12T22:55:51.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122932025-08-12T22:55:51.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122942025-08-12T22:55:51.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122952025-08-12T22:55:51.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
122962025-08-12T22:55:51.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122972025-08-12T22:55:51.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122982025-08-12T22:55:51.191ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 139.65251ms iteration = 26 status = 0
122992025-08-12T22:55:51.194ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 143.245355ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
123002025-08-12T22:55:51.198ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123012025-08-12T22:55:51.198ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
123022025-08-12T22:55:51.198ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 146.91634ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
123032025-08-12T22:55:51.210ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.245721ms iteration = 29 status = {"physical_disks_added":0}
123042025-08-12T22:55:51.216ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123052025-08-12T22:55:51.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
123062025-08-12T22:55:51.218ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
123072025-08-12T22:55:51.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
123082025-08-12T22:55:51.255ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
123092025-08-12T22:55:51.255ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 204.230013ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
123102025-08-12T22:55:51.261ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 210.910468ms iteration = 26 status = {}
123112025-08-12T22:55:51.264ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
123122025-08-12T22:55:51.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
123132025-08-12T22:55:51.266ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 216.087859ms iteration = 26 status = null
123142025-08-12T22:55:51.292ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
123152025-08-12T22:55:51.292ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "66504479-64dd-4e36-a84c-1227f741c2bc", "content-length": "691", "date": "Tue, 12 Aug 2025 22:55:51 GMT"} })
123162025-08-12T22:55:51.292ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
123172025-08-12T22:55:51.292ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
123182025-08-12T22:55:51.292ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
123192025-08-12T22:55:51.293ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 242.552419ms iteration = 27 status = {}
123202025-08-12T22:55:51.386ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
123212025-08-12T22:55:51.386ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
123222025-08-12T22:55:51.386ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1eead55-bf91-4084-ae57-dc80e69077d1", "content-length": "372", "date": "Tue, 12 Aug 2025 22:55:51 GMT"} })
123232025-08-12T22:55:51.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123242025-08-12T22:55:51.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123252025-08-12T22:55:51.431ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123262025-08-12T22:55:51.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123272025-08-12T22:55:51.433ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
123282025-08-12T22:55:51.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123292025-08-12T22:55:51.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123302025-08-12T22:55:51.446ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
123312025-08-12T22:55:51.446ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
123322025-08-12T22:55:51.446ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "966ac1ef-1968-4333-be3e-b6165c0aaf7c", "date": "Tue, 12 Aug 2025 22:55:51 GMT"} })
123332025-08-12T22:55:51.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123342025-08-12T22:55:51.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123352025-08-12T22:55:51.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123362025-08-12T22:55:51.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123372025-08-12T22:55:51.453ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
123382025-08-12T22:55:51.453ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
123392025-08-12T22:55:51.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123402025-08-12T22:55:51.453ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
123412025-08-12T22:55:51.453ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
123422025-08-12T22:55:51.453ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123432025-08-12T22:55:51.453ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123442025-08-12T22:55:51.453ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123452025-08-12T22:55:51.453ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123462025-08-12T22:55:51.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123472025-08-12T22:55:51.453ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123482025-08-12T22:55:51.453ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123492025-08-12T22:55:51.453ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
123502025-08-12T22:55:51.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123512025-08-12T22:55:51.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123522025-08-12T22:55:51.456ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
123532025-08-12T22:55:51.456ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
123542025-08-12T22:55:51.457ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
123552025-08-12T22:55:51.457ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
123562025-08-12T22:55:51.464ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "efbcca20-eb41-405b-9161-a5f6e64b855b", "date": "Tue, 12 Aug 2025 22:55:51 GMT"} })
123572025-08-12T22:55:51.465ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 414.320783ms iteration = 27 status = {}
123582025-08-12T22:55:51.572ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "db23e61a-c4e3-4537-a142-62c144a26e56", "date": "Tue, 12 Aug 2025 22:55:51 GMT"} })
123592025-08-12T22:55:51.572ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
123602025-08-12T22:55:51.572ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
123612025-08-12T22:55:51.573ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f30fb1a2-da7b-49ca-b245-e6d11bfca036", "content-length": "682", "date": "Tue, 12 Aug 2025 22:55:51 GMT"} })
123622025-08-12T22:55:51.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123632025-08-12T22:55:51.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123642025-08-12T22:55:51.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123652025-08-12T22:55:51.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123662025-08-12T22:55:51.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123672025-08-12T22:55:51.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123682025-08-12T22:55:51.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123692025-08-12T22:55:51.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123702025-08-12T22:55:51.589ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 538.539772ms iteration = 26 status = {}
123712025-08-12T22:55:51.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ea06d846-af20-4f40-a004-64855a19ce56 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123722025-08-12T22:55:51.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ea06d846-af20-4f40-a004-64855a19ce56 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123732025-08-12T22:55:51.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ea06d846-af20-4f40-a004-64855a19ce56 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123742025-08-12T22:55:52.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e0a6ded-0126-4e3e-b50f-327c27eacabf roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123752025-08-12T22:55:52.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e0a6ded-0126-4e3e-b50f-327c27eacabf resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123762025-08-12T22:55:52.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 0e0a6ded-0126-4e3e-b50f-327c27eacabf response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123772025-08-12T22:55:53.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a30e03a0-3ead-4cf0-8ad6-546dab2ea7b8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123782025-08-12T22:55:53.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a30e03a0-3ead-4cf0-8ad6-546dab2ea7b8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123792025-08-12T22:55:53.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a30e03a0-3ead-4cf0-8ad6-546dab2ea7b8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123802025-08-12T22:55:54.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8135f441-eabc-40b4-9029-4c4a00b191ed roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123812025-08-12T22:55:54.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8135f441-eabc-40b4-9029-4c4a00b191ed resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123822025-08-12T22:55:54.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8135f441-eabc-40b4-9029-4c4a00b191ed response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123832025-08-12T22:55:55.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3a0af0a1-50c3-4811-b98a-64ae9037a0de roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123842025-08-12T22:55:55.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3a0af0a1-50c3-4811-b98a-64ae9037a0de resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123852025-08-12T22:55:55.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2666 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 3a0af0a1-50c3-4811-b98a-64ae9037a0de response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123862025-08-12T22:55:56.051ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 152 reason = Timeout
123872025-08-12T22:55:56.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
123882025-08-12T22:55:56.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
123892025-08-12T22:55:56.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123902025-08-12T22:55:56.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
123912025-08-12T22:55:56.057ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
123922025-08-12T22:55:56.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
123932025-08-12T22:55:56.060ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
123942025-08-12T22:55:56.060ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.356492ms iteration = 152 status = {"chicken_switches_updated":false}
123952025-08-12T22:55:56.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b297bb49-7029-465b-9c2e-23376836a923 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123962025-08-12T22:55:56.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b297bb49-7029-465b-9c2e-23376836a923 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123972025-08-12T22:55:56.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = b297bb49-7029-465b-9c2e-23376836a923 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123982025-08-12T22:55:57.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b33788f-752f-4b8c-b4e1-2ca8ef561908 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
123992025-08-12T22:55:57.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b33788f-752f-4b8c-b4e1-2ca8ef561908 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124002025-08-12T22:55:57.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b33788f-752f-4b8c-b4e1-2ca8ef561908 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124012025-08-12T22:55:58.839ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 624 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 733fcb22-6723-4dc1-9442-1f0fcfc94397 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
124022025-08-12T22:55:58.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4d3d6336-42a7-4b84-a549-e0e58b21628b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124032025-08-12T22:55:58.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4d3d6336-42a7-4b84-a549-e0e58b21628b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124042025-08-12T22:55:58.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4d3d6336-42a7-4b84-a549-e0e58b21628b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124052025-08-12T22:55:59.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = adff89fb-3aaa-491a-8d65-25d48caded41 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124062025-08-12T22:55:59.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = adff89fb-3aaa-491a-8d65-25d48caded41 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124072025-08-12T22:55:59.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = adff89fb-3aaa-491a-8d65-25d48caded41 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124082025-08-12T22:56:00.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8a90e553-8525-4e7f-8c8c-0c241871cca0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124092025-08-12T22:56:00.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8a90e553-8525-4e7f-8c8c-0c241871cca0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124102025-08-12T22:56:00.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8a90e553-8525-4e7f-8c8c-0c241871cca0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124112025-08-12T22:56:01.051ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
124122025-08-12T22:56:01.051ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
124132025-08-12T22:56:01.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124142025-08-12T22:56:01.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124152025-08-12T22:56:01.051ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 153 reason = Timeout
124162025-08-12T22:56:01.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
124172025-08-12T22:56:01.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124182025-08-12T22:56:01.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
124192025-08-12T22:56:01.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124202025-08-12T22:56:01.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124212025-08-12T22:56:01.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124222025-08-12T22:56:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124232025-08-12T22:56:01.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124242025-08-12T22:56:01.056ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.522634ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
124252025-08-12T22:56:01.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124262025-08-12T22:56:01.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124272025-08-12T22:56:01.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124282025-08-12T22:56:01.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
124292025-08-12T22:56:01.058ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
124302025-08-12T22:56:01.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
124312025-08-12T22:56:01.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124322025-08-12T22:56:01.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124332025-08-12T22:56:01.060ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
124342025-08-12T22:56:01.060ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.357222ms iteration = 153 status = {"chicken_switches_updated":false}
124352025-08-12T22:56:01.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124362025-08-12T22:56:01.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
124372025-08-12T22:56:01.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124382025-08-12T22:56:01.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124392025-08-12T22:56:01.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
124402025-08-12T22:56:01.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.6275ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
124412025-08-12T22:56:01.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e93b4770-259c-4e3c-bbdc-970d274af7c2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124422025-08-12T22:56:01.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e93b4770-259c-4e3c-bbdc-970d274af7c2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124432025-08-12T22:56:02.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e93b4770-259c-4e3c-bbdc-970d274af7c2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124442025-08-12T22:56:03.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 72fcc404-f9b9-4079-84f4-7b48cdbc6ee6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124452025-08-12T22:56:03.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 72fcc404-f9b9-4079-84f4-7b48cdbc6ee6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124462025-08-12T22:56:03.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 72fcc404-f9b9-4079-84f4-7b48cdbc6ee6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124472025-08-12T22:56:04.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1f00d049-51eb-4921-aa46-8b8ba82be569 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124482025-08-12T22:56:04.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1f00d049-51eb-4921-aa46-8b8ba82be569 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124492025-08-12T22:56:04.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1f00d049-51eb-4921-aa46-8b8ba82be569 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124502025-08-12T22:56:05.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 312dad6f-dc22-4e8e-a189-304ca8e2b6fa roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124512025-08-12T22:56:05.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 312dad6f-dc22-4e8e-a189-304ca8e2b6fa resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124522025-08-12T22:56:05.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 312dad6f-dc22-4e8e-a189-304ca8e2b6fa response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124532025-08-12T22:56:06.051ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 154 reason = Timeout
124542025-08-12T22:56:06.051ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
124552025-08-12T22:56:06.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
124562025-08-12T22:56:06.053ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124572025-08-12T22:56:06.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
124582025-08-12T22:56:06.056ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
124592025-08-12T22:56:06.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
124602025-08-12T22:56:06.058ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
124612025-08-12T22:56:06.058ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.023529ms iteration = 154 status = {"chicken_switches_updated":false}
124622025-08-12T22:56:06.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dd3fbf89-e6a9-489a-84a7-c611487f4702 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124632025-08-12T22:56:06.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dd3fbf89-e6a9-489a-84a7-c611487f4702 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124642025-08-12T22:56:06.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = dd3fbf89-e6a9-489a-84a7-c611487f4702 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124652025-08-12T22:56:07.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1918925d-f45e-4675-8172-063b05b7b852 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124662025-08-12T22:56:07.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1918925d-f45e-4675-8172-063b05b7b852 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124672025-08-12T22:56:07.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1918925d-f45e-4675-8172-063b05b7b852 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124682025-08-12T22:56:08.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7d19efed-11de-43ee-8729-81cd3f21d718 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124692025-08-12T22:56:08.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7d19efed-11de-43ee-8729-81cd3f21d718 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124702025-08-12T22:56:08.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1863 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7d19efed-11de-43ee-8729-81cd3f21d718 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124712025-08-12T22:56:08.839ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 746 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = bb81b7fe-50c7-4375-9caf-8374eb7c2485 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
124722025-08-12T22:56:09.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1af1978f-783b-4942-b3ae-1c3b6590bb89 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124732025-08-12T22:56:09.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1af1978f-783b-4942-b3ae-1c3b6590bb89 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124742025-08-12T22:56:09.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1af1978f-783b-4942-b3ae-1c3b6590bb89 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124752025-08-12T22:56:10.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2929acfd-823e-4c9d-a799-9f40f4ad7e26 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124762025-08-12T22:56:10.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2929acfd-823e-4c9d-a799-9f40f4ad7e26 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124772025-08-12T22:56:10.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2929acfd-823e-4c9d-a799-9f40f4ad7e26 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
124782025-08-12T22:56:11.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
124792025-08-12T22:56:11.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124802025-08-12T22:56:11.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
124812025-08-12T22:56:11.052ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 155 reason = Timeout
124822025-08-12T22:56:11.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124832025-08-12T22:56:11.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
124842025-08-12T22:56:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124852025-08-12T22:56:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124862025-08-12T22:56:11.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
124872025-08-12T22:56:11.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124882025-08-12T22:56:11.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124892025-08-12T22:56:11.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124902025-08-12T22:56:11.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124912025-08-12T22:56:11.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124922025-08-12T22:56:11.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
124932025-08-12T22:56:11.058ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
124942025-08-12T22:56:11.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
124952025-08-12T22:56:11.060ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
124962025-08-12T22:56:11.060ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.860987ms iteration = 155 status = {"chicken_switches_updated":false}
124972025-08-12T22:56:11.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124982025-08-12T22:56:11.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124992025-08-12T22:56:11.089ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125002025-08-12T22:56:11.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125012025-08-12T22:56:11.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.304186ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125022025-08-12T22:56:11.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125032025-08-12T22:56:11.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
125042025-08-12T22:56:11.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125052025-08-12T22:56:11.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125062025-08-12T22:56:11.115ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
125072025-08-12T22:56:11.115ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.800646ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
125082025-08-12T22:56:11.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f15484de-2e5c-4743-a5fe-bf30229dc6bb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125092025-08-12T22:56:11.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f15484de-2e5c-4743-a5fe-bf30229dc6bb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125102025-08-12T22:56:11.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f15484de-2e5c-4743-a5fe-bf30229dc6bb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125112025-08-12T22:56:12.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cb800a8b-2444-468f-b3fd-70a17c0babf9 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125122025-08-12T22:56:12.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cb800a8b-2444-468f-b3fd-70a17c0babf9 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125132025-08-12T22:56:12.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cb800a8b-2444-468f-b3fd-70a17c0babf9 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125142025-08-12T22:56:13.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ed9b178f-79ae-423c-abff-c61a557de8f8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125152025-08-12T22:56:13.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ed9b178f-79ae-423c-abff-c61a557de8f8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125162025-08-12T22:56:13.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ed9b178f-79ae-423c-abff-c61a557de8f8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125172025-08-12T22:56:13.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 3ab5f1c4-faee-4fb4-9969-cc3794066f48 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
125182025-08-12T22:56:13.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 3ab5f1c4-faee-4fb4-9969-cc3794066f48 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
125192025-08-12T22:56:13.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 3ab5f1c4-faee-4fb4-9969-cc3794066f48 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
125202025-08-12T22:56:13.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = a54ba466-46df-4902-a2df-af23a2542f01 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
125212025-08-12T22:56:13.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = a54ba466-46df-4902-a2df-af23a2542f01 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
125222025-08-12T22:56:13.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = a54ba466-46df-4902-a2df-af23a2542f01 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
125232025-08-12T22:56:14.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7239cd2a-17d6-4684-ae99-369600615231 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125242025-08-12T22:56:14.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7239cd2a-17d6-4684-ae99-369600615231 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125252025-08-12T22:56:14.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7239cd2a-17d6-4684-ae99-369600615231 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125262025-08-12T22:56:15.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 50a01ec2-485f-45d5-85ec-f37be360817a roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125272025-08-12T22:56:15.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 50a01ec2-485f-45d5-85ec-f37be360817a resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125282025-08-12T22:56:15.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 50a01ec2-485f-45d5-85ec-f37be360817a response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125292025-08-12T22:56:16.052ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 156 reason = Timeout
125302025-08-12T22:56:16.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
125312025-08-12T22:56:16.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
125322025-08-12T22:56:16.055ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125332025-08-12T22:56:16.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
125342025-08-12T22:56:16.057ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
125352025-08-12T22:56:16.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
125362025-08-12T22:56:16.060ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
125372025-08-12T22:56:16.060ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.584434ms iteration = 156 status = {"chicken_switches_updated":false}
125382025-08-12T22:56:16.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ff91a5ca-6038-47b8-915e-fc5a5a14d58b roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125392025-08-12T22:56:16.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ff91a5ca-6038-47b8-915e-fc5a5a14d58b resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125402025-08-12T22:56:16.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2688 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = ff91a5ca-6038-47b8-915e-fc5a5a14d58b response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125412025-08-12T22:56:17.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 55888b67-6480-4565-8b56-fb379a6711fa roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125422025-08-12T22:56:17.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 55888b67-6480-4565-8b56-fb379a6711fa resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125432025-08-12T22:56:17.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 55888b67-6480-4565-8b56-fb379a6711fa response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125442025-08-12T22:56:18.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 97c64b14-5901-4307-9652-0da758eda5fb roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125452025-08-12T22:56:18.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 97c64b14-5901-4307-9652-0da758eda5fb resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125462025-08-12T22:56:18.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 97c64b14-5901-4307-9652-0da758eda5fb response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125472025-08-12T22:56:18.840ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 798 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = a215f43f-c47f-4f63-9485-debdc3940e24 response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
125482025-08-12T22:56:19.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 33a5993e-7155-4b8f-9a76-c759d7914752 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125492025-08-12T22:56:19.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 33a5993e-7155-4b8f-9a76-c759d7914752 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125502025-08-12T22:56:19.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 33a5993e-7155-4b8f-9a76-c759d7914752 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125512025-08-12T22:56:20.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 14197fd1-e770-4387-a606-c00b292dbc6e roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125522025-08-12T22:56:20.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 14197fd1-e770-4387-a606-c00b292dbc6e resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125532025-08-12T22:56:20.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 14197fd1-e770-4387-a606-c00b292dbc6e response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
125542025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
125552025-08-12T22:56:21.051ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0
125562025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
125572025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
125582025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.59\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0"}
125592025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
125602025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
125612025-08-12T22:56:21.051ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-08-12 22:46:21.051398786 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
125622025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
125632025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
125642025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
125652025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
125662025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
125672025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
125682025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
125692025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
125702025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
125712025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
125722025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
125732025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
125742025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
125752025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
125762025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
125772025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 18 reason = Timeout
125782025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
125792025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
125802025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 11.29\u{b5}s iteration = 18 status = "Disabled"
125812025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
125822025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
125832025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
125842025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
125852025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
125862025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
125872025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
125882025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
125892025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
125902025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125912025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125922025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
125932025-08-12T22:56:21.051ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
125942025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
125952025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125962025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 27 reason = Timeout
125972025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125982025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 10.309\u{b5}s iteration = 27 status = {"disabled":true,"errors":[],"sps":[]}
125992025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
126002025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
126012025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
126022025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
126032025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
126042025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
126052025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
126062025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
126072025-08-12T22:56:21.051ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
126082025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
126092025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
126102025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
126112025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
126122025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
126132025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
126142025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
126152025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
126162025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
126172025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 157 reason = Timeout
126182025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
126192025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 14 reason = Timeout
126202025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
126212025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
126222025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
126232025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
126242025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 14 reason = Timeout
126252025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
126262025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
126272025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
126282025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
126292025-08-12T22:56:21.052ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
126302025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
126312025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
126322025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126332025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
126342025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
126352025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
126362025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
126372025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
126382025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
126392025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
126402025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126412025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
126422025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
126432025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
126442025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126452025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126462025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
126472025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126482025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
126492025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
126502025-08-12T22:56:21.052ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3e3264d-303d-4ce7-a0ce-0090b10b154f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("d7d2275f-b0bb-4a69-bcc5-687d9e81abaf.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::8)) }], valid_until: Instant { tv_sec: 1783, tv_nsec: 282464246 } })
126512025-08-12T22:56:21.052ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("043b8097-0e38-4228-bada-dac70e518148.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("26cd5275-57f5-4466-a94f-f96956f55588.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("8253fe02-839f-41b4-8a48-6bea72a7f423.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:2::1)) }], valid_until: Instant { tv_sec: 1783, tv_nsec: 282477306 } })
126522025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
126532025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126542025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
126552025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
126562025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
126572025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
126582025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
126592025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
126602025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
126612025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
126622025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
126632025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
126642025-08-12T22:56:21.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
126652025-08-12T22:56:21.053ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
126662025-08-12T22:56:21.053ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.612395ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
126672025-08-12T22:56:21.053ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
126682025-08-12T22:56:21.053ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.615805ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
126692025-08-12T22:56:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
126702025-08-12T22:56:21.054ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-08-12 22:46:21.051398786 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
126712025-08-12T22:56:21.054ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.299332ms iteration = 14 status = {"expiration":"2025-08-12T22:46:21.051398786Z","pruned":[]}
126722025-08-12T22:56:21.054ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1783, tv_nsec: 284976381 } })
126732025-08-12T22:56:21.055ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1783, tv_nsec: 285175772 } })
126742025-08-12T22:56:21.055ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
126752025-08-12T22:56:21.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126762025-08-12T22:56:21.055ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
126772025-08-12T22:56:21.056ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.321903ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
126782025-08-12T22:56:21.056ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126792025-08-12T22:56:21.056ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.212151ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
126802025-08-12T22:56:21.056ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126812025-08-12T22:56:21.057ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126822025-08-12T22:56:21.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126832025-08-12T22:56:21.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
126842025-08-12T22:56:21.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126852025-08-12T22:56:21.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126862025-08-12T22:56:21.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126872025-08-12T22:56:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
126882025-08-12T22:56:21.060ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
126892025-08-12T22:56:21.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
126902025-08-12T22:56:21.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126912025-08-12T22:56:21.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126922025-08-12T22:56:21.061ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
126932025-08-12T22:56:21.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
126942025-08-12T22:56:21.062ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
126952025-08-12T22:56:21.062ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 10.17996ms iteration = 14 status = {"by_rx":{},"error":null}
126962025-08-12T22:56:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
126972025-08-12T22:56:21.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
126982025-08-12T22:56:21.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
126992025-08-12T22:56:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
127002025-08-12T22:56:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
127012025-08-12T22:56:21.063ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
127022025-08-12T22:56:21.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127032025-08-12T22:56:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
127042025-08-12T22:56:21.064ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
127052025-08-12T22:56:21.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
127062025-08-12T22:56:21.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127072025-08-12T22:56:21.066ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 14.26533ms iteration = 14 status = {"dispatched":[],"errors":[],"glob_version":"180.0.0","globs_reprocessed":{},"no_receivers":[]}
127082025-08-12T22:56:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127092025-08-12T22:56:21.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127102025-08-12T22:56:21.066ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127112025-08-12T22:56:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
127122025-08-12T22:56:21.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127132025-08-12T22:56:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127142025-08-12T22:56:21.066ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127152025-08-12T22:56:21.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127162025-08-12T22:56:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127172025-08-12T22:56:21.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
127182025-08-12T22:56:21.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127192025-08-12T22:56:21.067ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
127202025-08-12T22:56:21.067ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 15.457781ms iteration = 157 status = {"chicken_switches_updated":false}
127212025-08-12T22:56:21.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127222025-08-12T22:56:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127232025-08-12T22:56:21.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127242025-08-12T22:56:21.069ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127252025-08-12T22:56:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
127262025-08-12T22:56:21.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127272025-08-12T22:56:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127282025-08-12T22:56:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
127292025-08-12T22:56:21.069ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
127302025-08-12T22:56:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127312025-08-12T22:56:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127322025-08-12T22:56:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
127332025-08-12T22:56:21.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127342025-08-12T22:56:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
127352025-08-12T22:56:21.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127362025-08-12T22:56:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127372025-08-12T22:56:21.119ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127382025-08-12T22:56:21.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127392025-08-12T22:56:21.125ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127402025-08-12T22:56:21.125ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127412025-08-12T22:56:21.125ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127422025-08-12T22:56:21.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127432025-08-12T22:56:21.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127442025-08-12T22:56:21.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.859594ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
127452025-08-12T22:56:21.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
127462025-08-12T22:56:21.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127472025-08-12T22:56:21.128ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127482025-08-12T22:56:21.128ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
127492025-08-12T22:56:21.128ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127502025-08-12T22:56:21.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127512025-08-12T22:56:21.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
127522025-08-12T22:56:21.128ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127532025-08-12T22:56:21.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127542025-08-12T22:56:21.128ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
127552025-08-12T22:56:21.128ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
127562025-08-12T22:56:21.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127572025-08-12T22:56:21.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
127582025-08-12T22:56:21.129ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
127592025-08-12T22:56:21.130ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
127602025-08-12T22:56:21.130ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
127612025-08-12T22:56:21.130ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 78.141277ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
127622025-08-12T22:56:21.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
127632025-08-12T22:56:21.130ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127642025-08-12T22:56:21.130ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
127652025-08-12T22:56:21.130ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127662025-08-12T22:56:21.130ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 78.993325ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
127672025-08-12T22:56:21.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127682025-08-12T22:56:21.131ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127692025-08-12T22:56:21.132ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
127702025-08-12T22:56:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
127712025-08-12T22:56:21.133ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1783, tv_nsec: 363235028 } })
127722025-08-12T22:56:21.133ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 81.59961ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
127732025-08-12T22:56:21.133ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
127742025-08-12T22:56:21.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
127752025-08-12T22:56:21.133ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
127762025-08-12T22:56:21.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
127772025-08-12T22:56:21.135ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127782025-08-12T22:56:21.135ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
127792025-08-12T22:56:21.135ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
127802025-08-12T22:56:21.135ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
127812025-08-12T22:56:21.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127822025-08-12T22:56:21.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127832025-08-12T22:56:21.137ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
127842025-08-12T22:56:21.137ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
127852025-08-12T22:56:21.137ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
127862025-08-12T22:56:21.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
127872025-08-12T22:56:21.137ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
127882025-08-12T22:56:21.137ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.68338ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
127892025-08-12T22:56:21.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
127902025-08-12T22:56:21.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127912025-08-12T22:56:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
127922025-08-12T22:56:21.138ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
127932025-08-12T22:56:21.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
127942025-08-12T22:56:21.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127952025-08-12T22:56:21.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
127962025-08-12T22:56:21.141ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127972025-08-12T22:56:21.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127982025-08-12T22:56:21.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
127992025-08-12T22:56:21.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128002025-08-12T22:56:21.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128012025-08-12T22:56:21.143ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
128022025-08-12T22:56:21.144ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 0 version = 2
128032025-08-12T22:56:21.144ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128042025-08-12T22:56:21.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128052025-08-12T22:56:21.145ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128062025-08-12T22:56:21.147ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
128072025-08-12T22:56:21.147ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.075422ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
128082025-08-12T22:56:21.148ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128092025-08-12T22:56:21.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128102025-08-12T22:56:21.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
128112025-08-12T22:56:21.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128122025-08-12T22:56:21.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128132025-08-12T22:56:21.150ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128142025-08-12T22:56:21.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128152025-08-12T22:56:21.151ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 52923e89-9001-4a95-b049-d1e3307b42f6 dns_zone_name = oxide.test found_so_far = 4 version = 2
128162025-08-12T22:56:21.151ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
128172025-08-12T22:56:21.151ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-08-12 22:43:50.527483 UTC dns_group = external generation = 2
128182025-08-12T22:56:21.151ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 100.579616ms iteration = 14 status = {"generation":2}
128192025-08-12T22:56:21.152ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128202025-08-12T22:56:21.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
128212025-08-12T22:56:21.155ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128222025-08-12T22:56:21.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128232025-08-12T22:56:21.158ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 106.324533ms iteration = 27 status = 0
128242025-08-12T22:56:21.160ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128252025-08-12T22:56:21.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128262025-08-12T22:56:21.162ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128272025-08-12T22:56:21.164ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128282025-08-12T22:56:21.164ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128292025-08-12T22:56:21.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128302025-08-12T22:56:21.164ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 112.695876ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
128312025-08-12T22:56:21.164ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128322025-08-12T22:56:21.165ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128332025-08-12T22:56:21.167ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
128342025-08-12T22:56:21.167ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 115.345552ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
128352025-08-12T22:56:21.167ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128362025-08-12T22:56:21.167ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128372025-08-12T22:56:21.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128382025-08-12T22:56:21.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
128392025-08-12T22:56:21.168ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128402025-08-12T22:56:21.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128412025-08-12T22:56:21.170ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
128422025-08-12T22:56:21.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
128432025-08-12T22:56:21.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 119.855516ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
128442025-08-12T22:56:21.177ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128452025-08-12T22:56:21.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128462025-08-12T22:56:21.179ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128472025-08-12T22:56:21.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
128482025-08-12T22:56:21.182ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128492025-08-12T22:56:21.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128502025-08-12T22:56:21.186ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
128512025-08-12T22:56:21.186ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
128522025-08-12T22:56:21.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128532025-08-12T22:56:21.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128542025-08-12T22:56:21.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 136.029824ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
128552025-08-12T22:56:21.188ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
128562025-08-12T22:56:21.188ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
128572025-08-12T22:56:21.188ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 136.207396ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
128582025-08-12T22:56:21.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128592025-08-12T22:56:21.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
128602025-08-12T22:56:21.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128612025-08-12T22:56:21.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128622025-08-12T22:56:21.194ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128632025-08-12T22:56:21.194ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
128642025-08-12T22:56:21.194ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.957862ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
128652025-08-12T22:56:21.195ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b5521ae7-bed4-4be5-8545-0f0d46b03fe0 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
128662025-08-12T22:56:21.196ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
128672025-08-12T22:56:21.196ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-08-12 22:43:49.909589 UTC dns_group = internal generation = 1
128682025-08-12T22:56:21.196ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 144.308516ms iteration = 14 status = {"generation":1}
128692025-08-12T22:56:21.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
128702025-08-12T22:56:21.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
128712025-08-12T22:56:21.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 167.24326ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
128722025-08-12T22:56:21.226ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 174.525262ms iteration = 30 status = {"physical_disks_added":0}
128732025-08-12T22:56:21.237ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-08-12T22:43:09.981233Z, time_modified: 2025-08-12T22:43:09.981233Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, db_silo: Silo { identity: SiloIdentity { id: 4604c0f4-e471-4d75-8d0c-f1105f332e2d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-08-12T22:43:50.449969Z, time_modified: 2025-08-12T22:43:50.449969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b" }] }) }
128742025-08-12T22:56:21.237ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 185.874293ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]}},"default_endpoint":{"silo_id":"4604c0f4-e471-4d75-8d0c-f1105f332e2d","tls_certs":["113ea2d0a240ee6303aeae1d6a03baff10a844b7fadccb89429031cb83190d4b"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
128752025-08-12T22:56:21.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 27122005-a7e9-4a0e-9148-2389871defe6 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
128762025-08-12T22:56:21.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 27122005-a7e9-4a0e-9148-2389871defe6 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
128772025-08-12T22:56:21.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 27122005-a7e9-4a0e-9148-2389871defe6 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
128782025-08-12T22:56:21.375ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
128792025-08-12T22:56:21.375ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128802025-08-12T22:56:21.376ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2dc7101-769a-454e-aad0-f15e400fb0dc", "content-length": "372", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} })
128812025-08-12T22:56:21.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128822025-08-12T22:56:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128832025-08-12T22:56:21.383ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
128842025-08-12T22:56:21.383ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 331.499181ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
128852025-08-12T22:56:21.384ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
128862025-08-12T22:56:21.403ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
128872025-08-12T22:56:21.403ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128882025-08-12T22:56:21.403ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86814568-adb8-4058-8168-1f60d9d70ece", "content-length": "26", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} })
128892025-08-12T22:56:21.403ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128902025-08-12T22:56:21.405ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
128912025-08-12T22:56:21.406ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
128922025-08-12T22:56:21.422ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
128932025-08-12T22:56:21.422ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128942025-08-12T22:56:21.423ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11de4c6c-aa04-4441-901c-476d1d4ce02e", "content-length": "26", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} })
128952025-08-12T22:56:21.423ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128962025-08-12T22:56:21.425ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
128972025-08-12T22:56:21.439ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
128982025-08-12T22:56:21.439ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128992025-08-12T22:56:21.439ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec8decd3-766f-453e-bfa9-b2fd6ccf6908", "content-length": "26", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} })
129002025-08-12T22:56:21.440ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129012025-08-12T22:56:21.444ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
129022025-08-12T22:56:21.457ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
129032025-08-12T22:56:21.457ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
129042025-08-12T22:56:21.458ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "44737fb4-1f05-483b-9140-11c3d98a7b1c", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} })
129052025-08-12T22:56:21.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129062025-08-12T22:56:21.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129072025-08-12T22:56:21.460ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129082025-08-12T22:56:21.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129092025-08-12T22:56:21.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129102025-08-12T22:56:21.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129112025-08-12T22:56:21.467ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
129122025-08-12T22:56:21.467ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
129132025-08-12T22:56:21.468ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bb20f329-66d0-4282-9de0-3e281c363d00", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} })
129142025-08-12T22:56:21.471ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 419.956299ms iteration = 28 status = {}
129152025-08-12T22:56:21.477ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
129162025-08-12T22:56:21.477ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0726de7-60c5-4d3c-b45c-be33c3d46fe9", "content-length": "691", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} })
129172025-08-12T22:56:21.477ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
129182025-08-12T22:56:21.477ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
129192025-08-12T22:56:21.477ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
129202025-08-12T22:56:21.479ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 428.23103ms iteration = 28 status = {}
129212025-08-12T22:56:21.555ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 504.449788ms iteration = 27 status = {}
129222025-08-12T22:56:21.575ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
129232025-08-12T22:56:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
129242025-08-12T22:56:21.577ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 525.718136ms iteration = 27 status = null
129252025-08-12T22:56:21.660ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
129262025-08-12T22:56:21.662ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
129272025-08-12T22:56:21.662ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5b0a9930-3ed5-4baf-bb30-134eab3a48fb", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129282025-08-12T22:56:21.662ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129292025-08-12T22:56:21.664ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d9f9f7ff-7828-4e8c-a618-df50669dab58", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129302025-08-12T22:56:21.664ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129312025-08-12T22:56:21.667ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129322025-08-12T22:56:21.667ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 615.771169ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
129332025-08-12T22:56:21.723ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
129342025-08-12T22:56:21.723ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "44e21371-8e21-4a45-b3a1-22d987dc0ab1", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
129352025-08-12T22:56:21.723ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
129362025-08-12T22:56:21.724ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "90b1ca8b-1d11-40aa-9e9e-979eb70b61b4", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
129372025-08-12T22:56:21.724ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
129382025-08-12T22:56:21.726ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "70a2e18f-9cea-4bda-be2a-a9e827e68f2e", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
129392025-08-12T22:56:21.726ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
129402025-08-12T22:56:21.727ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
129412025-08-12T22:56:21.727ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 676.404164ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
129422025-08-12T22:56:21.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129432025-08-12T22:56:21.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129442025-08-12T22:56:21.734ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
129452025-08-12T22:56:21.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129462025-08-12T22:56:21.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129472025-08-12T22:56:21.747ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
129482025-08-12T22:56:21.747ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
129492025-08-12T22:56:21.747ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
129502025-08-12T22:56:21.747ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
129512025-08-12T22:56:21.747ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129522025-08-12T22:56:21.747ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129532025-08-12T22:56:21.747ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129542025-08-12T22:56:21.747ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
129552025-08-12T22:56:21.747ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129562025-08-12T22:56:21.747ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
129572025-08-12T22:56:21.748ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
129582025-08-12T22:56:21.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129592025-08-12T22:56:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129602025-08-12T22:56:21.750ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
129612025-08-12T22:56:21.750ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
129622025-08-12T22:56:21.862ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "feba8641-432a-47a6-b0e0-7b4c940ab023", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} })
129632025-08-12T22:56:21.862ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
129642025-08-12T22:56:21.862ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
129652025-08-12T22:56:21.869ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f504942-1b82-43b5-8e00-7b95aac139ca", "content-length": "682", "date": "Tue, 12 Aug 2025 22:56:21 GMT"} })
129662025-08-12T22:56:21.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129672025-08-12T22:56:21.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129682025-08-12T22:56:21.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129692025-08-12T22:56:21.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129702025-08-12T22:56:21.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129712025-08-12T22:56:21.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129722025-08-12T22:56:21.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129732025-08-12T22:56:21.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129742025-08-12T22:56:21.887ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 835.316693ms iteration = 27 status = {}
129752025-08-12T22:56:22.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f732a571-27b6-4a9d-a331-4feff4d29b58 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129762025-08-12T22:56:22.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f732a571-27b6-4a9d-a331-4feff4d29b58 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129772025-08-12T22:56:22.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f732a571-27b6-4a9d-a331-4feff4d29b58 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129782025-08-12T22:56:23.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4f15dd52-4e81-491e-84cd-b368742800f5 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129792025-08-12T22:56:23.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4f15dd52-4e81-491e-84cd-b368742800f5 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129802025-08-12T22:56:23.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4f15dd52-4e81-491e-84cd-b368742800f5 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129812025-08-12T22:56:24.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = aa2fabea-e67f-446c-968d-4c1e8e9121c8 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129822025-08-12T22:56:24.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = aa2fabea-e67f-446c-968d-4c1e8e9121c8 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129832025-08-12T22:56:24.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = aa2fabea-e67f-446c-968d-4c1e8e9121c8 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129842025-08-12T22:56:25.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e8a56851-58ee-4438-924f-e096771b46af roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129852025-08-12T22:56:25.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e8a56851-58ee-4438-924f-e096771b46af resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129862025-08-12T22:56:25.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = e8a56851-58ee-4438-924f-e096771b46af response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129872025-08-12T22:56:26.052ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 158 reason = Timeout
129882025-08-12T22:56:26.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
129892025-08-12T22:56:26.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
129902025-08-12T22:56:26.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129912025-08-12T22:56:26.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
129922025-08-12T22:56:26.057ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
129932025-08-12T22:56:26.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
129942025-08-12T22:56:26.059ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
129952025-08-12T22:56:26.059ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.618615ms iteration = 158 status = {"chicken_switches_updated":false}
129962025-08-12T22:56:26.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 34b05bf1-fc4d-4d6e-ac0c-40a0a73b91f3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129972025-08-12T22:56:26.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 34b05bf1-fc4d-4d6e-ac0c-40a0a73b91f3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129982025-08-12T22:56:26.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 34b05bf1-fc4d-4d6e-ac0c-40a0a73b91f3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
129992025-08-12T22:56:27.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 446657fa-1c0f-447a-abbe-e7f85c57eacf roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130002025-08-12T22:56:27.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 446657fa-1c0f-447a-abbe-e7f85c57eacf resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130012025-08-12T22:56:27.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 446657fa-1c0f-447a-abbe-e7f85c57eacf response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130022025-08-12T22:56:28.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a5254f46-fd1f-4982-82ca-e0e9620fe608 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130032025-08-12T22:56:28.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a5254f46-fd1f-4982-82ca-e0e9620fe608 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130042025-08-12T22:56:28.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = a5254f46-fd1f-4982-82ca-e0e9620fe608 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130052025-08-12T22:56:28.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 1f2f643b-c245-4672-aaf6-836c88596f36 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
130062025-08-12T22:56:28.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 1f2f643b-c245-4672-aaf6-836c88596f36 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
130072025-08-12T22:56:28.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 1f2f643b-c245-4672-aaf6-836c88596f36 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
130082025-08-12T22:56:28.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = aa7c4ab6-a95a-40fc-9a9b-7bb9f7fcd7e6 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
130092025-08-12T22:56:28.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = aa7c4ab6-a95a-40fc-9a9b-7bb9f7fcd7e6 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
130102025-08-12T22:56:28.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = aa7c4ab6-a95a-40fc-9a9b-7bb9f7fcd7e6 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
130112025-08-12T22:56:28.839ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 596 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = cc35ebcb-8cda-4c69-8423-7e14d5ccb11d response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
130122025-08-12T22:56:29.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 32819f87-71ba-4b4e-b0d7-eab865b46f35 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130132025-08-12T22:56:29.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 32819f87-71ba-4b4e-b0d7-eab865b46f35 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130142025-08-12T22:56:29.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 32819f87-71ba-4b4e-b0d7-eab865b46f35 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130152025-08-12T22:56:30.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b42a78b-657b-4e7e-b592-329625c717d4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130162025-08-12T22:56:30.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b42a78b-657b-4e7e-b592-329625c717d4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130172025-08-12T22:56:30.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4b42a78b-657b-4e7e-b592-329625c717d4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130182025-08-12T22:56:31.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
130192025-08-12T22:56:31.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
130202025-08-12T22:56:31.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130212025-08-12T22:56:31.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130222025-08-12T22:56:31.052ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 159 reason = Timeout
130232025-08-12T22:56:31.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
130242025-08-12T22:56:31.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130252025-08-12T22:56:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
130262025-08-12T22:56:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130272025-08-12T22:56:31.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130282025-08-12T22:56:31.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
130292025-08-12T22:56:31.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130302025-08-12T22:56:31.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130312025-08-12T22:56:31.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130322025-08-12T22:56:31.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130332025-08-12T22:56:31.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130342025-08-12T22:56:31.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
130352025-08-12T22:56:31.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130362025-08-12T22:56:31.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130372025-08-12T22:56:31.085ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
130382025-08-12T22:56:31.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.988784ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
130392025-08-12T22:56:31.096ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130402025-08-12T22:56:31.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130412025-08-12T22:56:31.098ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 46.088083ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
130422025-08-12T22:56:31.098ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130432025-08-12T22:56:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
130442025-08-12T22:56:31.101ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
130452025-08-12T22:56:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
130462025-08-12T22:56:31.103ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
130472025-08-12T22:56:31.103ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 51.267883ms iteration = 159 status = {"chicken_switches_updated":false}
130482025-08-12T22:56:31.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cfccf94a-c7b6-4710-aa49-2d6292c67eec roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130492025-08-12T22:56:31.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cfccf94a-c7b6-4710-aa49-2d6292c67eec resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130502025-08-12T22:56:31.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = cfccf94a-c7b6-4710-aa49-2d6292c67eec response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130512025-08-12T22:56:32.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 846aa2fd-4663-4c5b-82bd-5e53d9161ad3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130522025-08-12T22:56:32.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 846aa2fd-4663-4c5b-82bd-5e53d9161ad3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130532025-08-12T22:56:32.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2759 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 846aa2fd-4663-4c5b-82bd-5e53d9161ad3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130542025-08-12T22:56:33.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 254bfb7c-e704-437b-997d-fe2e73dec042 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130552025-08-12T22:56:33.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 254bfb7c-e704-437b-997d-fe2e73dec042 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130562025-08-12T22:56:33.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 254bfb7c-e704-437b-997d-fe2e73dec042 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130572025-08-12T22:56:34.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eeda8131-e44f-46b5-8fc4-4b618e815525 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130582025-08-12T22:56:34.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eeda8131-e44f-46b5-8fc4-4b618e815525 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130592025-08-12T22:56:34.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = eeda8131-e44f-46b5-8fc4-4b618e815525 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130602025-08-12T22:56:35.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f009b825-b070-49f7-b7bb-7b3ab97775b7 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130612025-08-12T22:56:35.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f009b825-b070-49f7-b7bb-7b3ab97775b7 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130622025-08-12T22:56:35.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = f009b825-b070-49f7-b7bb-7b3ab97775b7 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130632025-08-12T22:56:36.052ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 160 reason = Timeout
130642025-08-12T22:56:36.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
130652025-08-12T22:56:36.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
130662025-08-12T22:56:36.054ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130672025-08-12T22:56:36.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
130682025-08-12T22:56:36.057ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
130692025-08-12T22:56:36.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
130702025-08-12T22:56:36.058ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
130712025-08-12T22:56:36.058ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.721826ms iteration = 160 status = {"chicken_switches_updated":false}
130722025-08-12T22:56:36.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9abe9b35-257e-413c-9193-e2ff4bcb14f3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130732025-08-12T22:56:36.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9abe9b35-257e-413c-9193-e2ff4bcb14f3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130742025-08-12T22:56:36.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 9abe9b35-257e-413c-9193-e2ff4bcb14f3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130752025-08-12T22:56:37.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8411f16a-b273-4fa8-af00-524a8e0afe65 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130762025-08-12T22:56:37.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8411f16a-b273-4fa8-af00-524a8e0afe65 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130772025-08-12T22:56:37.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8411f16a-b273-4fa8-af00-524a8e0afe65 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130782025-08-12T22:56:38.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 822a8ec1-5ff5-4f1f-b043-61c956acf577 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130792025-08-12T22:56:38.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 822a8ec1-5ff5-4f1f-b043-61c956acf577 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130802025-08-12T22:56:38.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 822a8ec1-5ff5-4f1f-b043-61c956acf577 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130812025-08-12T22:56:38.840ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 591 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = fca775e7-2e40-4d4e-a0b3-d8d38b315b7d response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
130822025-08-12T22:56:39.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8d807341-0b32-4327-988e-6ad15e406ff3 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130832025-08-12T22:56:39.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8d807341-0b32-4327-988e-6ad15e406ff3 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130842025-08-12T22:56:39.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 8d807341-0b32-4327-988e-6ad15e406ff3 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130852025-08-12T22:56:40.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d1162d57-3e5c-4671-aab9-beb4722f2a79 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130862025-08-12T22:56:40.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d1162d57-3e5c-4671-aab9-beb4722f2a79 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130872025-08-12T22:56:40.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = d1162d57-3e5c-4671-aab9-beb4722f2a79 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
130882025-08-12T22:56:41.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
130892025-08-12T22:56:41.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130902025-08-12T22:56:41.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
130912025-08-12T22:56:41.052ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 161 reason = Timeout
130922025-08-12T22:56:41.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130932025-08-12T22:56:41.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
130942025-08-12T22:56:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
130952025-08-12T22:56:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130962025-08-12T22:56:41.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130972025-08-12T22:56:41.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130982025-08-12T22:56:41.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
130992025-08-12T22:56:41.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131002025-08-12T22:56:41.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131012025-08-12T22:56:41.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131022025-08-12T22:56:41.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131032025-08-12T22:56:41.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131042025-08-12T22:56:41.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
131052025-08-12T22:56:41.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131062025-08-12T22:56:41.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131072025-08-12T22:56:41.078ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
131082025-08-12T22:56:41.078ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.999665ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
131092025-08-12T22:56:41.091ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131102025-08-12T22:56:41.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131112025-08-12T22:56:41.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131122025-08-12T22:56:41.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.650548ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
131132025-08-12T22:56:41.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
131142025-08-12T22:56:41.094ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
131152025-08-12T22:56:41.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
131162025-08-12T22:56:41.096ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
131172025-08-12T22:56:41.096ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 43.208853ms iteration = 161 status = {"chicken_switches_updated":false}
131182025-08-12T22:56:41.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 67f1d90f-0490-482e-b7fe-bbd0c1494966 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131192025-08-12T22:56:41.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 67f1d90f-0490-482e-b7fe-bbd0c1494966 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131202025-08-12T22:56:41.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 67f1d90f-0490-482e-b7fe-bbd0c1494966 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131212025-08-12T22:56:42.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 40853a4d-9799-42d7-86ed-ca50b65b5a5c roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131222025-08-12T22:56:42.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 40853a4d-9799-42d7-86ed-ca50b65b5a5c resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131232025-08-12T22:56:42.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 40853a4d-9799-42d7-86ed-ca50b65b5a5c response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131242025-08-12T22:56:43.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c1402e86-fc5c-4f95-bc49-2094d34396ca roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131252025-08-12T22:56:43.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c1402e86-fc5c-4f95-bc49-2094d34396ca resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131262025-08-12T22:56:43.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c1402e86-fc5c-4f95-bc49-2094d34396ca response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131272025-08-12T22:56:43.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = d4d2283d-4c43-4c13-9799-358360239bf7 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
131282025-08-12T22:56:43.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = d4d2283d-4c43-4c13-9799-358360239bf7 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
131292025-08-12T22:56:43.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = d4d2283d-4c43-4c13-9799-358360239bf7 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?sort_by=id_ascending
131302025-08-12T22:56:43.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 7befe716-2dce-4b98-b58b-ba30685abc05 roles = RoleSet { roles: {} } uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
131312025-08-12T22:56:43.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 7befe716-2dce-4b98-b58b-ba30685abc05 resource = Database result = Ok(()) uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
131322025-08-12T22:56:43.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57209 req_id = 7befe716-2dce-4b98-b58b-ba30685abc05 response_code = 200 uri = /metrics/collectors/4c467f25-cb67-42ad-b276-c490b467a350/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjgxMWY2Ny01NjE1LTQyZTUtOGU0Ny0yZTQ4OWM2NTNkNGEifX0%3D
131332025-08-12T22:56:44.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bdf55854-8cc8-4488-ab94-124e03934931 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131342025-08-12T22:56:44.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bdf55854-8cc8-4488-ab94-124e03934931 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131352025-08-12T22:56:44.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = bdf55854-8cc8-4488-ab94-124e03934931 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131362025-08-12T22:56:45.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7999b17a-8193-434c-9f26-ccd4702e2bd9 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131372025-08-12T22:56:45.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7999b17a-8193-434c-9f26-ccd4702e2bd9 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131382025-08-12T22:56:45.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 7999b17a-8193-434c-9f26-ccd4702e2bd9 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131392025-08-12T22:56:46.052ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 162 reason = Timeout
131402025-08-12T22:56:46.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
131412025-08-12T22:56:46.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
131422025-08-12T22:56:46.055ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131432025-08-12T22:56:46.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
131442025-08-12T22:56:46.057ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
131452025-08-12T22:56:46.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
131462025-08-12T22:56:46.060ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
131472025-08-12T22:56:46.060ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.279511ms iteration = 162 status = {"chicken_switches_updated":false}
131482025-08-12T22:56:46.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = da29aa98-7834-42f7-9f66-92a3d49d1043 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131492025-08-12T22:56:46.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = da29aa98-7834-42f7-9f66-92a3d49d1043 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131502025-08-12T22:56:46.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = da29aa98-7834-42f7-9f66-92a3d49d1043 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131512025-08-12T22:56:47.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1ae62e9a-af0e-409e-85c2-89ca4d9e69d4 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131522025-08-12T22:56:47.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1ae62e9a-af0e-409e-85c2-89ca4d9e69d4 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131532025-08-12T22:56:47.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1ae62e9a-af0e-409e-85c2-89ca4d9e69d4 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131542025-08-12T22:56:48.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2887db23-fffd-4b91-aaf8-c738df1d3116 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131552025-08-12T22:56:48.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2887db23-fffd-4b91-aaf8-c738df1d3116 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131562025-08-12T22:56:48.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2887db23-fffd-4b91-aaf8-c738df1d3116 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131572025-08-12T22:56:48.840ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 523 local_addr = [fd00:1122:3344:101::c]:49740 method = GET remote_addr = [fd00:1122:3344:101::d]:58820 req_id = 36f47f6e-3e2b-49bc-bf36-4a86f66d620e response_code = 200 uri = /8c95eed0-ca33-44fa-9752-6c25556f7542
131582025-08-12T22:56:49.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 97a9ad09-9e8f-474d-8d2f-99d447e0d4e0 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131592025-08-12T22:56:49.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 97a9ad09-9e8f-474d-8d2f-99d447e0d4e0 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131602025-08-12T22:56:49.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 97a9ad09-9e8f-474d-8d2f-99d447e0d4e0 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131612025-08-12T22:56:50.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c65c1779-8342-4487-a0a8-66e15886a5cd roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131622025-08-12T22:56:50.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c65c1779-8342-4487-a0a8-66e15886a5cd resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131632025-08-12T22:56:50.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = c65c1779-8342-4487-a0a8-66e15886a5cd response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
131642025-08-12T22:56:51.051ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
131652025-08-12T22:56:51.051ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
131662025-08-12T22:56:51.051ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
131672025-08-12T22:56:51.051ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
131682025-08-12T22:56:51.051ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
131692025-08-12T22:56:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
131702025-08-12T22:56:51.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
131712025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
131722025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 28 reason = Timeout
131732025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
131742025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
131752025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131762025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
131772025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
131782025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 17.78\u{b5}s iteration = 28 status = {"disabled":true,"errors":[],"sps":[]}
131792025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
131802025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
131812025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131822025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
131832025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131842025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
131852025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
131862025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
131872025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
131882025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
131892025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
131902025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
131912025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
131922025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131932025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
131942025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 163 reason = Timeout
131952025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
131962025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
131972025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
131982025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
131992025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
132002025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
132012025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132022025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 28 reason = Timeout
132032025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
132042025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
132052025-08-12T22:56:51.052ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
132062025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132072025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
132082025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
132092025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132102025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132112025-08-12T22:56:51.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
132122025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
132132025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132142025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132152025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
132162025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132172025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132182025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
132192025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
132202025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
132212025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132222025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
132232025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
132242025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
132252025-08-12T22:56:51.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132262025-08-12T22:56:51.054ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1813, tv_nsec: 284010920 } })
132272025-08-12T22:56:51.054ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1813, tv_nsec: 284010910 } })
132282025-08-12T22:56:51.054ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1195
132292025-08-12T22:56:51.054ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1195
132302025-08-12T22:56:51.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132312025-08-12T22:56:51.055ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132322025-08-12T22:56:51.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132332025-08-12T22:56:51.055ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.774827ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
132342025-08-12T22:56:51.055ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132352025-08-12T22:56:51.055ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
132362025-08-12T22:56:51.055ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
132372025-08-12T22:56:51.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
132382025-08-12T22:56:51.055ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.444483ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
132392025-08-12T22:56:51.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132402025-08-12T22:56:51.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132412025-08-12T22:56:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
132422025-08-12T22:56:51.059ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
132432025-08-12T22:56:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
132442025-08-12T22:56:51.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
132452025-08-12T22:56:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
132462025-08-12T22:56:51.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
132472025-08-12T22:56:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
132482025-08-12T22:56:51.060ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
132492025-08-12T22:56:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132502025-08-12T22:56:51.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132512025-08-12T22:56:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
132522025-08-12T22:56:51.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132532025-08-12T22:56:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
132542025-08-12T22:56:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132552025-08-12T22:56:51.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132562025-08-12T22:56:51.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132572025-08-12T22:56:51.062ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
132582025-08-12T22:56:51.062ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 9.983297ms iteration = 163 status = {"chicken_switches_updated":false}
132592025-08-12T22:56:51.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132602025-08-12T22:56:51.062ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132612025-08-12T22:56:51.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132622025-08-12T22:56:51.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132632025-08-12T22:56:51.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132642025-08-12T22:56:51.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
132652025-08-12T22:56:51.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132662025-08-12T22:56:51.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132672025-08-12T22:56:51.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5b83f618-a56c-47ff-8645-e66df0256fd0, lookup_type: ById(5b83f618-a56c-47ff-8645-e66df0256fd0) } result = Ok(())
132682025-08-12T22:56:51.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132692025-08-12T22:56:51.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132702025-08-12T22:56:51.097ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 original_time_created = 2025-08-12 22:43:08.501882 UTC target_id = 5b83f618-a56c-47ff-8645-e66df0256fd0 time_created = 2025-08-12 22:43:08.501882 UTC
132712025-08-12T22:56:51.097ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.053262ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5b83f618-a56c-47ff-8645-e66df0256fd0","time_created":"2025-08-12T22:43:08.501882Z"}
132722025-08-12T22:56:51.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
132732025-08-12T22:56:51.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
132742025-08-12T22:56:51.104ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
132752025-08-12T22:56:51.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132762025-08-12T22:56:51.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132772025-08-12T22:56:51.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
132782025-08-12T22:56:51.105ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.07567ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
132792025-08-12T22:56:51.106ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
132802025-08-12T22:56:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
132812025-08-12T22:56:51.107ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
132822025-08-12T22:56:51.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132832025-08-12T22:56:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132842025-08-12T22:56:51.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132852025-08-12T22:56:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
132862025-08-12T22:56:51.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132872025-08-12T22:56:51.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132882025-08-12T22:56:51.110ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
132892025-08-12T22:56:51.110ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
132902025-08-12T22:56:51.110ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
132912025-08-12T22:56:51.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132922025-08-12T22:56:51.110ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132932025-08-12T22:56:51.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132942025-08-12T22:56:51.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
132952025-08-12T22:56:51.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132962025-08-12T22:56:51.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132972025-08-12T22:56:51.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132982025-08-12T22:56:51.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132992025-08-12T22:56:51.112ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
133002025-08-12T22:56:51.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
133012025-08-12T22:56:51.113ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 61.107189ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
133022025-08-12T22:56:51.114ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
133032025-08-12T22:56:51.114ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.018378ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
133042025-08-12T22:56:51.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133052025-08-12T22:56:51.116ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
133062025-08-12T22:56:51.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
133072025-08-12T22:56:51.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133082025-08-12T22:56:51.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133092025-08-12T22:56:51.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
133102025-08-12T22:56:51.117ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133112025-08-12T22:56:51.119ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-d04697ae-b4b1-419d-b9da-432e45c93990.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1813, tv_nsec: 348631413 } })
133122025-08-12T22:56:51.119ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1195 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
133132025-08-12T22:56:51.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
133142025-08-12T22:56:51.120ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
133152025-08-12T22:56:51.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
133162025-08-12T22:56:51.122ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.277289ms iteration = 28 status = {"errors":[],"requests_created_ok":[]}
133172025-08-12T22:56:51.132ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
133182025-08-12T22:56:51.132ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133192025-08-12T22:56:51.133ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "216d81a8-8790-485a-91f6-0151ef8850b6", "content-length": "26", "date": "Tue, 12 Aug 2025 22:56:51 GMT"} })
133202025-08-12T22:56:51.133ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133212025-08-12T22:56:51.135ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
133222025-08-12T22:56:51.137ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1203 zone_address = fd00:1122:3344:101::2
133232025-08-12T22:56:51.137ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133242025-08-12T22:56:51.137ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1728cd9-cd90-429a-b586-d6e7bf93d356", "content-length": "26", "date": "Tue, 12 Aug 2025 22:56:51 GMT"} })
133252025-08-12T22:56:51.137ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1206 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133262025-08-12T22:56:51.139ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
133272025-08-12T22:56:51.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 99.438905ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
133282025-08-12T22:56:51.157ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 104.98986ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
133292025-08-12T22:56:51.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133302025-08-12T22:56:51.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133312025-08-12T22:56:51.160ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133322025-08-12T22:56:51.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133332025-08-12T22:56:51.162ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133342025-08-12T22:56:51.163ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133352025-08-12T22:56:51.163ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
133362025-08-12T22:56:51.163ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 111.211021ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
133372025-08-12T22:56:51.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: d04697ae-b4b1-419d-b9da-432e45c93990, lookup_type: ById(d04697ae-b4b1-419d-b9da-432e45c93990) } result = Ok(())
133382025-08-12T22:56:51.165ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133392025-08-12T22:56:51.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133402025-08-12T22:56:51.165ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.397952ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133412025-08-12T22:56:51.167ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 114.460983ms iteration = 28 status = 0
133422025-08-12T22:56:51.172ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:407
133432025-08-12T22:56:51.172ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 120.387881ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
133442025-08-12T22:56:51.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133452025-08-12T22:56:51.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133462025-08-12T22:56:51.208ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 155.676627ms iteration = 31 status = {"physical_disks_added":0}
133472025-08-12T22:56:51.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133482025-08-12T22:56:51.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133492025-08-12T22:56:51.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133502025-08-12T22:56:51.216ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
133512025-08-12T22:56:51.216ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133522025-08-12T22:56:51.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133532025-08-12T22:56:51.217ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133542025-08-12T22:56:51.219ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
133552025-08-12T22:56:51.219ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133562025-08-12T22:56:51.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133572025-08-12T22:56:51.225ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
133582025-08-12T22:56:51.225ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
133592025-08-12T22:56:51.225ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c12a91bd-ac89-4dd7-9d94-2fb981018ced", "content-length": "372", "date": "Tue, 12 Aug 2025 22:56:51 GMT"} })
133602025-08-12T22:56:51.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133612025-08-12T22:56:51.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133622025-08-12T22:56:51.230ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1203 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 zone_address = fd00:1122:3344:101::2
133632025-08-12T22:56:51.230ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133642025-08-12T22:56:51.231ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "36cf40f2-acc7-4b54-b215-6d2b6284cd8a", "content-length": "26", "date": "Tue, 12 Aug 2025 22:56:51 GMT"} })
133652025-08-12T22:56:51.231ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1206 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133662025-08-12T22:56:51.232ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1240 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
133672025-08-12T22:56:51.241ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
133682025-08-12T22:56:51.241ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
133692025-08-12T22:56:51.241ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "13fdcad4-7cc6-49b9-a7c1-aec7825c7f95", "date": "Tue, 12 Aug 2025 22:56:51 GMT"} })
133702025-08-12T22:56:51.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133712025-08-12T22:56:51.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133722025-08-12T22:56:51.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133732025-08-12T22:56:51.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133742025-08-12T22:56:51.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133752025-08-12T22:56:51.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133762025-08-12T22:56:51.255ZINFOnexus (BackgroundTasks): VPC route manager sled d04697ae-b4b1-419d-b9da-432e45c93990 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
133772025-08-12T22:56:51.256ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
133782025-08-12T22:56:51.256ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6a4b269a-9d5a-4da9-854a-b0fd99870958", "date": "Tue, 12 Aug 2025 22:56:51 GMT"} })
133792025-08-12T22:56:51.258ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 207.598366ms iteration = 28 status = {}
133802025-08-12T22:56:51.259ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 206.630597ms iteration = 29 status = {}
133812025-08-12T22:56:51.280ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
133822025-08-12T22:56:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
133832025-08-12T22:56:51.283ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 232.007375ms iteration = 28 status = null
133842025-08-12T22:56:51.321ZDEBGnexus (BackgroundTasks): client request SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
133852025-08-12T22:56:51.321ZDEBGnexus (BackgroundTasks): client response SledAgent = d04697ae-b4b1-419d-b9da-432e45c93990 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c301ba1-9f0a-4db1-98cb-241d59526075", "content-length": "691", "date": "Tue, 12 Aug 2025 22:56:51 GMT"} })
133862025-08-12T22:56:51.321ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
133872025-08-12T22:56:51.321ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
133882025-08-12T22:56:51.321ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
133892025-08-12T22:56:51.323ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 270.788406ms iteration = 29 status = {}
133902025-08-12T22:56:51.383ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133912025-08-12T22:56:51.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133922025-08-12T22:56:51.390ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6bc1f64c-02f3-4f1c-a85a-58bb5a11ffd5, rack_id: 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(3dd8097e-2017-42f6-a72f-f84cf0c8badc) } rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
133932025-08-12T22:56:51.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133942025-08-12T22:56:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133952025-08-12T22:56:51.410ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
133962025-08-12T22:56:51.410ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 3dd8097e-2017-42f6-a72f-f84cf0c8badc
133972025-08-12T22:56:51.410ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
133982025-08-12T22:56:51.410ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
133992025-08-12T22:56:51.410ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134002025-08-12T22:56:51.410ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134012025-08-12T22:56:51.410ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134022025-08-12T22:56:51.410ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
134032025-08-12T22:56:51.410ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134042025-08-12T22:56:51.410ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
134052025-08-12T22:56:51.411ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64
134062025-08-12T22:56:51.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134072025-08-12T22:56:51.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134082025-08-12T22:56:51.414ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch_location = Switch0
134092025-08-12T22:56:51.414ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
134102025-08-12T22:56:51.535ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "876f7877-e600-4c89-abfa-70047031f7b9", "date": "Tue, 12 Aug 2025 22:56:51 GMT"} })
134112025-08-12T22:56:51.535ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 switch = Switch0
134122025-08-12T22:56:51.535ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
134132025-08-12T22:56:51.535ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8d11df7e-a4bc-4e49-a4f9-fdf2c26b9c64 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6773d670-341a-4c92-a34f-aed424a8c599", "content-length": "682", "date": "Tue, 12 Aug 2025 22:56:51 GMT"} })
134142025-08-12T22:56:51.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134152025-08-12T22:56:51.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134162025-08-12T22:56:51.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134172025-08-12T22:56:51.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134182025-08-12T22:56:51.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134192025-08-12T22:56:51.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134202025-08-12T22:56:51.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134212025-08-12T22:56:51.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134222025-08-12T22:56:51.552ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 500.399838ms iteration = 28 status = {}
134232025-08-12T22:56:51.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1de2d6a1-dad0-4318-958d-e667cb71dcd2 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
134242025-08-12T22:56:51.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1de2d6a1-dad0-4318-958d-e667cb71dcd2 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
134252025-08-12T22:56:51.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 1de2d6a1-dad0-4318-958d-e667cb71dcd2 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
134262025-08-12T22:56:51.999ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 5
134272025-08-12T22:56:51.999ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221
134282025-08-12T22:56:52.029ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
134292025-08-12T22:56:52.029ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:47631
134302025-08-12T22:56:52.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47631 req_id = e99e418f-8acb-40cf-864b-4072af0a9ce5 roles = RoleSet { roles: {} } uri = /metrics/producers
134312025-08-12T22:56:52.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47631 req_id = e99e418f-8acb-40cf-864b-4072af0a9ce5 resource = Database result = Ok(()) uri = /metrics/producers
134322025-08-12T22:56:52.077ZINFOnexus: assigned collector to new producer collector_id = 4c467f25-cb67-42ad-b276-c490b467a350 file = nexus/src/app/oximeter.rs:76 producer_id = 8c95eed0-ca33-44fa-9752-6c25556f7542
134332025-08-12T22:56:52.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 47262 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47631 req_id = e99e418f-8acb-40cf-864b-4072af0a9ce5 response_code = 201 uri = /metrics/producers
134342025-08-12T22:56:52.077ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "e99e418f-8acb-40cf-864b-4072af0a9ce5", "content-length": "41", "date": "Tue, 12 Aug 2025 22:56:51 GMT"} })
134352025-08-12T22:56:52.078ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
134362025-08-12T22:56:52.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 506136a2-b890-4d21-9560-b2e22f897302 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
134372025-08-12T22:56:52.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 506136a2-b890-4d21-9560-b2e22f897302 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
134382025-08-12T22:56:52.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 506136a2-b890-4d21-9560-b2e22f897302 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
134392025-08-12T22:56:53.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4968763f-12a4-4b23-9b8a-3834c3be827d roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
134402025-08-12T22:56:53.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4968763f-12a4-4b23-9b8a-3834c3be827d resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
134412025-08-12T22:56:53.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 4968763f-12a4-4b23-9b8a-3834c3be827d response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
134422025-08-12T22:56:54.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2f58e0b6-6e6c-45cd-903c-e4f74a970907 roles = RoleSet { roles: {} } uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
134432025-08-12T22:56:54.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2f58e0b6-6e6c-45cd-903c-e4f74a970907 resource = Database result = Ok(()) uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990
134442025-08-12T22:56:54.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43844 req_id = 2f58e0b6-6e6c-45cd-903c-e4f74a970907 response_code = 200 uri = /probes/d04697ae-b4b1-419d-b9da-432e45c93990